2021-03-09T08:34:09.958 INFO:root:teuthology version: 1.1.0-3082387b 2021-03-09T08:34:09.962 DEBUG:teuthology.run:Teuthology command: teuthology --name kchai-2021-03-09_08:22:40-rados-wip-kefu-testing-2021-03-09-1428-distro-basic-smithi --verbose --description rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} --archive /home/teuthworker/archive/kchai-2021-03-09_08:22:40-rados-wip-kefu-testing-2021-03-09-1428-distro-basic-smithi/5949085 --owner scheduled_kchai@teuthology -- /home/teuthworker/archive/kchai-2021-03-09_08:22:40-rados-wip-kefu-testing-2021-03-09-1428-distro-basic-smithi/5949085/orig.config.yaml 2021-03-09T08:34:10.004 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-03-09T08:34:10.065 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kchai-2021-03-09_08:22:40-rados-wip-kefu-testing-2021-03-09-1428-distro-basic-smithi/5949085 branch: wip-kefu-testing-2021-03-09-1428 description: rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} email: tchaikov@gmail.com first_in_suite: false job_id: '5949085' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: kchai-2021-03-09_08:22:40-rados-wip-kefu-testing-2021-03-09-1428-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 10 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: wip-kefu-testing-2021-03-09-1428 ceph: conf: client: debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr2: false ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) mon_bind_msgr2: false sha1: 89fb622b10ca2e58fe0c913a8956377a886e2ab4 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 89fb622b10ca2e58fe0c913a8956377a886e2ab4 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-kefu-testing-2021-03-09-1428 sha1: 89fb622b10ca2e58fe0c913a8956377a886e2ab4 owner: scheduled_kchai@teuthology priority: 60 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 89fb622b10ca2e58fe0c913a8956377a886e2ab4 sleep_before_teardown: 0 suite: rados suite_branch: wip-kefu-testing-2021-03-09-1428 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_89fb622b10ca2e58fe0c913a8956377a886e2ab4/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 89fb622b10ca2e58fe0c913a8956377a886e2ab4 targets: smithi091.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDTnRj1c00cFXME3oKmR/4NlUlhDE19vrst/BO1W3K9mWReAO9tLpiEHFJmm9AsaNMLJ9ia+/VLPKODuNLqAvidPJSjqP3F3lFmVSHEk6t1EPXehVmJDa1QhAl0hPNrbgq6K/uUxvjKsL3/zxsA3d3INg+Bcm9HId8F4/OXk5KxpOOjc1qHYZxbBXGZITRFXMazhFGwlaoctA0x3YwBnb8RlVrMibKkuKpoxPYo7BQDYbtXc2ShwA4id2w3ATQpLEL2Ol7rkqm2R/t7Qxui334aFmfjUKBeP9QP5sx6g/ReKpCaYCCnXyi7SLBozdySMQWmUZReHhu73pd92jipkzFt smithi106.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRTVvrdUpxAVM5gpAfjT8PgDli6RQuKCLH6Z8dyM5lCzWGpd6VkfqMUWMRBencaI90KGFZDDs2JS9K9B942RHo0+KGzNPcjkTPMarjtuZu+KjYYMlgjcP3PnPa7a4G/Kg3v+QfigvvwLGIoTwbD9lRNhkRGAWUUEbTKd03KteyhNY4gOocfNm8cFRPUs9wu6PsQYAtKSyYBvBJM4tKEeaw1LFUE7M3J5aB9K/pEwN92P1ijjgniI7FbHhRJmPx1Urhzr6XJJ6DPLMNnJ7pZh+GDcin7nfLF7fdPkkSBv5SHzliUt6JeCmwgEyIZViq1aAlSe7g1ynnSuFYFhUYDiY7 tasks: - install: null - ceph: null - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology_branch: master teuthology_sha1: 3082387bba74fcd24c9700593d10418152d53c97 timestamp: 2021-03-09_08:22:40 tube: smithi user: kchai verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.25973 2021-03-09T08:34:10.065 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_89fb622b10ca2e58fe0c913a8956377a886e2ab4/qa; will attempt to use it 2021-03-09T08:34:10.074 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_89fb622b10ca2e58fe0c913a8956377a886e2ab4/qa/tasks 2021-03-09T08:34:10.075 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-03-09T08:34:10.078 INFO:teuthology.task.internal:Checking packages... 2021-03-09T08:34:10.155 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '89fb622b10ca2e58fe0c913a8956377a886e2ab4' 2021-03-09T08:34:10.157 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-03-09T08:34:10.157 INFO:teuthology.packaging:ref: None 2021-03-09T08:34:10.158 INFO:teuthology.packaging:tag: None 2021-03-09T08:34:10.158 INFO:teuthology.packaging:branch: wip-kefu-testing-2021-03-09-1428 2021-03-09T08:34:10.158 INFO:teuthology.packaging:sha1: 89fb622b10ca2e58fe0c913a8956377a886e2ab4 2021-03-09T08:34:10.159 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=wip-kefu-testing-2021-03-09-1428 2021-03-09T08:34:10.322 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-1742-g89fb622b-1bionic 2021-03-09T08:34:10.323 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-03-09T08:34:10.337 INFO:teuthology.task.internal:no buildpackages task found 2021-03-09T08:34:10.339 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-03-09T08:34:10.358 INFO:teuthology.task.internal:Saving configuration 2021-03-09T08:34:10.376 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-03-09T08:34:10.387 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-09T08:34:10.406 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-09 08:28:42.638869', 'description': '/home/teuthworker/archive/kchai-2021-03-09_08:22:40-rados-wip-kefu-testing-2021-03-09-1428-distro-basic-smithi/5949085', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILCCpBlQouVMWFPLTkVuMoauqGSCL7Hq6bdKmf/bmX9l', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi091.front.sepia.ceph.com'} 2021-03-09T08:34:10.424 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-09 08:28:42.638849', 'description': '/home/teuthworker/archive/kchai-2021-03-09_08:22:40-rados-wip-kefu-testing-2021-03-09-1428-distro-basic-smithi/5949085', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJR8sB0IDl+3z4Dg4Rf/ybpxEiq/jGUkpTgRPozJdfwC', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi106.front.sepia.ceph.com'} 2021-03-09T08:34:10.424 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-03-09T08:34:10.438 INFO:teuthology.task.internal:roles: ubuntu@smithi091.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-03-09T08:34:10.438 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-03-09T08:34:10.438 INFO:teuthology.run_tasks:Running task console_log... 2021-03-09T08:34:10.514 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f24b44fe950>, signals=[15]) 2021-03-09T08:34:10.516 INFO:teuthology.run_tasks:Running task internal.connect... 2021-03-09T08:34:10.526 INFO:teuthology.task.internal:Opening connections... 2021-03-09T08:34:10.527 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi091.front.sepia.ceph.com 2021-03-09T08:34:10.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-09T08:34:10.602 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2021-03-09T08:34:10.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-09T08:34:10.675 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-03-09T08:34:10.686 DEBUG:teuthology.orchestra.run.smithi091:> uname -m 2021-03-09T08:34:10.799 INFO:teuthology.orchestra.run.smithi091.stdout:x86_64 2021-03-09T08:34:10.799 DEBUG:teuthology.orchestra.run.smithi091:> cat /etc/os-release 2021-03-09T08:34:10.848 INFO:teuthology.orchestra.run.smithi091.stdout:NAME="Ubuntu" 2021-03-09T08:34:10.849 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-03-09T08:34:10.849 INFO:teuthology.orchestra.run.smithi091.stdout:ID=ubuntu 2021-03-09T08:34:10.849 INFO:teuthology.orchestra.run.smithi091.stdout:ID_LIKE=debian 2021-03-09T08:34:10.850 INFO:teuthology.orchestra.run.smithi091.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-03-09T08:34:10.850 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_ID="18.04" 2021-03-09T08:34:10.851 INFO:teuthology.orchestra.run.smithi091.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-09T08:34:10.851 INFO:teuthology.orchestra.run.smithi091.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-09T08:34:10.852 INFO:teuthology.orchestra.run.smithi091.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-09T08:34:10.852 INFO:teuthology.orchestra.run.smithi091.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-09T08:34:10.853 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_CODENAME=bionic 2021-03-09T08:34:10.854 INFO:teuthology.orchestra.run.smithi091.stdout:UBUNTU_CODENAME=bionic 2021-03-09T08:34:10.855 INFO:teuthology.lock.ops:Updating smithi091.front.sepia.ceph.com on lock server 2021-03-09T08:34:10.887 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2021-03-09T08:34:10.894 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2021-03-09T08:34:10.895 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2021-03-09T08:34:10.941 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Ubuntu" 2021-03-09T08:34:10.941 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-03-09T08:34:10.942 INFO:teuthology.orchestra.run.smithi106.stdout:ID=ubuntu 2021-03-09T08:34:10.942 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE=debian 2021-03-09T08:34:10.942 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-03-09T08:34:10.942 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="18.04" 2021-03-09T08:34:10.942 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-09T08:34:10.943 INFO:teuthology.orchestra.run.smithi106.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-09T08:34:10.943 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-09T08:34:10.943 INFO:teuthology.orchestra.run.smithi106.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-09T08:34:10.943 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_CODENAME=bionic 2021-03-09T08:34:10.944 INFO:teuthology.orchestra.run.smithi106.stdout:UBUNTU_CODENAME=bionic 2021-03-09T08:34:10.944 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2021-03-09T08:34:10.959 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-03-09T08:34:10.973 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-03-09T08:34:10.984 INFO:teuthology.task.internal:Checking for old test directory... 2021-03-09T08:34:10.985 DEBUG:teuthology.orchestra.run.smithi091:> test '!' -e /home/ubuntu/cephtest 2021-03-09T08:34:10.990 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2021-03-09T08:34:10.997 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-03-09T08:34:11.014 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-03-09T08:34:11.015 DEBUG:teuthology.orchestra.run.smithi091:> test -z $(ls -A /var/lib/ceph) 2021-03-09T08:34:11.038 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2021-03-09T08:34:11.063 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-03-09T08:34:11.120 INFO:teuthology.run_tasks:Running task kernel... 2021-03-09T08:34:11.148 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}} 2021-03-09T08:34:11.149 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-03-09T08:34:11.150 DEBUG:teuthology.orchestra.run.smithi091:> uname -r 2021-03-09T08:34:11.158 INFO:teuthology.orchestra.run.smithi091.stdout:4.15.0-136-generic 2021-03-09T08:34:11.159 INFO:teuthology.task.kernel:Running kernel on smithi091: 4.15.0-136-generic 2021-03-09T08:34:11.159 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get clean 2021-03-09T08:34:11.258 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get update 2021-03-09T08:34:12.191 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-03-09T08:34:12.798 INFO:teuthology.orchestra.run.smithi091.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-03-09T08:34:13.006 INFO:teuthology.orchestra.run.smithi091.stdout:Get:3 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-03-09T08:34:13.207 INFO:teuthology.orchestra.run.smithi091.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-03-09T08:34:13.525 INFO:teuthology.orchestra.run.smithi091.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,573 kB] 2021-03-09T08:34:14.400 INFO:teuthology.orchestra.run.smithi091.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,913 kB] 2021-03-09T08:34:14.772 INFO:teuthology.orchestra.run.smithi091.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [926 kB] 2021-03-09T08:34:15.014 INFO:teuthology.orchestra.run.smithi091.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [302 kB] 2021-03-09T08:34:15.094 INFO:teuthology.orchestra.run.smithi091.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [17.7 kB] 2021-03-09T08:34:15.098 INFO:teuthology.orchestra.run.smithi091.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [245 kB] 2021-03-09T08:34:15.283 INFO:teuthology.orchestra.run.smithi091.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [31.7 kB] 2021-03-09T08:34:15.289 INFO:teuthology.orchestra.run.smithi091.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,113 kB] 2021-03-09T08:34:15.505 INFO:teuthology.orchestra.run.smithi091.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [979 kB] 2021-03-09T08:34:15.645 INFO:teuthology.orchestra.run.smithi091.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [249 kB] 2021-03-09T08:34:15.671 INFO:teuthology.orchestra.run.smithi091.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [6,480 B] 2021-03-09T08:34:15.672 INFO:teuthology.orchestra.run.smithi091.stdout:Get:16 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [19.1 kB] 2021-03-09T08:34:15.676 INFO:teuthology.orchestra.run.smithi091.stdout:Get:17 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [4,412 B] 2021-03-09T08:34:17.913 INFO:teuthology.orchestra.run.smithi091.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,228 kB] 2021-03-09T08:34:18.398 INFO:teuthology.orchestra.run.smithi091.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [266 kB] 2021-03-09T08:34:18.532 INFO:teuthology.orchestra.run.smithi091.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [24.3 kB] 2021-03-09T08:34:18.537 INFO:teuthology.orchestra.run.smithi091.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [35.3 kB] 2021-03-09T08:34:18.545 INFO:teuthology.orchestra.run.smithi091.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,719 kB] 2021-03-09T08:34:18.874 INFO:teuthology.orchestra.run.smithi091.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,561 kB] 2021-03-09T08:34:19.121 INFO:teuthology.orchestra.run.smithi091.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [11.6 kB] 2021-03-09T08:34:19.122 INFO:teuthology.orchestra.run.smithi091.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [24.9 kB] 2021-03-09T08:34:19.123 INFO:teuthology.orchestra.run.smithi091.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [6,464 B] 2021-03-09T08:34:19.432 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 12.5 MB in 8s (1,568 kB/s) 2021-03-09T08:34:20.880 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2021-03-09T08:34:20.928 DEBUG:teuthology.orchestra.run.smithi091:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-03-09T08:34:21.010 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2021-03-09T08:34:21.245 INFO:teuthology.orchestra.run.smithi091.stdout:Building dependency tree... 2021-03-09T08:34:21.246 INFO:teuthology.orchestra.run.smithi091.stdout:Reading state information... 2021-03-09T08:34:21.325 INFO:teuthology.orchestra.run.smithi091.stderr:E: Unable to locate package linux-image-current-generic 2021-03-09T08:34:21.327 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-03-09T08:34:21.327 DEBUG:teuthology.orchestra.run.smithi091:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-03-09T08:34:21.407 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2021-03-09T08:34:21.648 INFO:teuthology.orchestra.run.smithi091.stdout:Building dependency tree... 2021-03-09T08:34:21.648 INFO:teuthology.orchestra.run.smithi091.stdout:Reading state information... 2021-03-09T08:34:21.851 INFO:teuthology.orchestra.run.smithi091.stdout:linux-image-generic is already the newest version (4.15.0.136.123). 2021-03-09T08:34:21.852 INFO:teuthology.orchestra.run.smithi091.stdout:linux-image-generic set to manually installed. 2021-03-09T08:34:21.852 INFO:teuthology.orchestra.run.smithi091.stdout:0 upgraded, 0 newly installed, 0 to remove and 15 not upgraded. 2021-03-09T08:34:21.853 DEBUG:teuthology.orchestra.run.smithi091:> dpkg -s linux-image-generic 2021-03-09T08:34:21.878 INFO:teuthology.orchestra.run.smithi091.stdout:Package: linux-image-generic 2021-03-09T08:34:21.878 INFO:teuthology.orchestra.run.smithi091.stdout:Status: install ok installed 2021-03-09T08:34:21.879 INFO:teuthology.orchestra.run.smithi091.stdout:Priority: optional 2021-03-09T08:34:21.879 INFO:teuthology.orchestra.run.smithi091.stdout:Section: kernel 2021-03-09T08:34:21.879 INFO:teuthology.orchestra.run.smithi091.stdout:Installed-Size: 17 2021-03-09T08:34:21.879 INFO:teuthology.orchestra.run.smithi091.stdout:Maintainer: Ubuntu Kernel Team 2021-03-09T08:34:21.879 INFO:teuthology.orchestra.run.smithi091.stdout:Architecture: amd64 2021-03-09T08:34:21.880 INFO:teuthology.orchestra.run.smithi091.stdout:Source: linux-meta 2021-03-09T08:34:21.880 INFO:teuthology.orchestra.run.smithi091.stdout:Version: 4.15.0.136.123 2021-03-09T08:34:21.880 INFO:teuthology.orchestra.run.smithi091.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-03-09T08:34:21.880 INFO:teuthology.orchestra.run.smithi091.stdout:Depends: linux-image-4.15.0-136-generic, linux-modules-extra-4.15.0-136-generic, linux-firmware, intel-microcode, amd64-microcode 2021-03-09T08:34:21.881 INFO:teuthology.orchestra.run.smithi091.stdout:Recommends: thermald 2021-03-09T08:34:21.881 INFO:teuthology.orchestra.run.smithi091.stdout:Description: Generic Linux kernel image 2021-03-09T08:34:21.881 INFO:teuthology.orchestra.run.smithi091.stdout: This package will always depend on the latest generic kernel image 2021-03-09T08:34:21.881 INFO:teuthology.orchestra.run.smithi091.stdout: available. 2021-03-09T08:34:21.882 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-03-09T08:34:21.882 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2021-03-09T08:34:21.889 INFO:teuthology.orchestra.run.smithi106.stdout:4.15.0-136-generic 2021-03-09T08:34:21.890 INFO:teuthology.task.kernel:Running kernel on smithi106: 4.15.0-136-generic 2021-03-09T08:34:21.890 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get clean 2021-03-09T08:34:22.041 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2021-03-09T08:34:22.318 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-03-09T08:34:22.376 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-03-09T08:34:22.639 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-03-09T08:34:22.716 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-03-09T08:34:22.789 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,913 kB] 2021-03-09T08:34:23.128 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [926 kB] 2021-03-09T08:34:23.147 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,228 kB] 2021-03-09T08:34:23.189 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [24.3 kB] 2021-03-09T08:34:23.190 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [266 kB] 2021-03-09T08:34:23.198 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [35.3 kB] 2021-03-09T08:34:23.199 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,719 kB] 2021-03-09T08:34:23.244 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,561 kB] 2021-03-09T08:34:23.295 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [11.6 kB] 2021-03-09T08:34:23.295 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [24.9 kB] 2021-03-09T08:34:23.296 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [6,464 B] 2021-03-09T08:34:23.475 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,573 kB] 2021-03-09T08:34:23.582 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [302 kB] 2021-03-09T08:34:23.598 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [245 kB] 2021-03-09T08:34:23.609 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [17.7 kB] 2021-03-09T08:34:23.609 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [31.7 kB] 2021-03-09T08:34:23.610 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,113 kB] 2021-03-09T08:34:23.648 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [979 kB] 2021-03-09T08:34:23.673 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [249 kB] 2021-03-09T08:34:23.679 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [6,480 B] 2021-03-09T08:34:23.679 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [19.1 kB] 2021-03-09T08:34:23.679 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [4,412 B] 2021-03-09T08:34:24.884 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 12.5 MB in 3s (4,770 kB/s) 2021-03-09T08:34:26.356 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2021-03-09T08:34:26.404 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-03-09T08:34:26.485 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2021-03-09T08:34:26.726 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2021-03-09T08:34:26.726 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2021-03-09T08:34:26.811 INFO:teuthology.orchestra.run.smithi106.stderr:E: Unable to locate package linux-image-current-generic 2021-03-09T08:34:26.812 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-03-09T08:34:26.814 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-03-09T08:34:26.896 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2021-03-09T08:34:27.141 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2021-03-09T08:34:27.141 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2021-03-09T08:34:27.346 INFO:teuthology.orchestra.run.smithi106.stdout:linux-image-generic is already the newest version (4.15.0.136.123). 2021-03-09T08:34:27.347 INFO:teuthology.orchestra.run.smithi106.stdout:linux-image-generic set to manually installed. 2021-03-09T08:34:27.347 INFO:teuthology.orchestra.run.smithi106.stdout:0 upgraded, 0 newly installed, 0 to remove and 15 not upgraded. 2021-03-09T08:34:27.348 DEBUG:teuthology.orchestra.run.smithi106:> dpkg -s linux-image-generic 2021-03-09T08:34:27.373 INFO:teuthology.orchestra.run.smithi106.stdout:Package: linux-image-generic 2021-03-09T08:34:27.374 INFO:teuthology.orchestra.run.smithi106.stdout:Status: install ok installed 2021-03-09T08:34:27.374 INFO:teuthology.orchestra.run.smithi106.stdout:Priority: optional 2021-03-09T08:34:27.374 INFO:teuthology.orchestra.run.smithi106.stdout:Section: kernel 2021-03-09T08:34:27.375 INFO:teuthology.orchestra.run.smithi106.stdout:Installed-Size: 17 2021-03-09T08:34:27.375 INFO:teuthology.orchestra.run.smithi106.stdout:Maintainer: Ubuntu Kernel Team 2021-03-09T08:34:27.375 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: amd64 2021-03-09T08:34:27.375 INFO:teuthology.orchestra.run.smithi106.stdout:Source: linux-meta 2021-03-09T08:34:27.375 INFO:teuthology.orchestra.run.smithi106.stdout:Version: 4.15.0.136.123 2021-03-09T08:34:27.376 INFO:teuthology.orchestra.run.smithi106.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-03-09T08:34:27.376 INFO:teuthology.orchestra.run.smithi106.stdout:Depends: linux-image-4.15.0-136-generic, linux-modules-extra-4.15.0-136-generic, linux-firmware, intel-microcode, amd64-microcode 2021-03-09T08:34:27.376 INFO:teuthology.orchestra.run.smithi106.stdout:Recommends: thermald 2021-03-09T08:34:27.376 INFO:teuthology.orchestra.run.smithi106.stdout:Description: Generic Linux kernel image 2021-03-09T08:34:27.376 INFO:teuthology.orchestra.run.smithi106.stdout: This package will always depend on the latest generic kernel image 2021-03-09T08:34:27.377 INFO:teuthology.orchestra.run.smithi106.stdout: available. 2021-03-09T08:34:27.377 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-03-09T08:34:27.377 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-03-09T08:34:27.378 DEBUG:teuthology.orchestra.run.smithi091:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-03-09T08:34:27.393 INFO:teuthology.orchestra.run.smithi091.stdout:ttyS1 2021-03-09T08:34:27.427 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-03-09T08:34:27.428 DEBUG:teuthology.orchestra.run.smithi106:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-03-09T08:34:27.445 INFO:teuthology.orchestra.run.smithi106.stdout:ttyS1 2021-03-09T08:34:27.469 INFO:teuthology.run_tasks:Running task internal.base... 2021-03-09T08:34:27.488 INFO:teuthology.task.internal:Creating test directory... 2021-03-09T08:34:27.490 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-09T08:34:27.495 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-09T08:34:27.518 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-03-09T08:34:27.530 INFO:teuthology.run_tasks:Running task internal.archive... 2021-03-09T08:34:27.542 INFO:teuthology.task.internal:Creating archive directory... 2021-03-09T08:34:27.543 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-09T08:34:27.551 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-09T08:34:27.581 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-03-09T08:34:27.592 INFO:teuthology.task.internal:Enabling coredump saving... 2021-03-09T08:34:27.592 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-03-09T08:34:27.605 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-03-09T08:34:27.621 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-09T08:34:27.628 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-09T08:34:27.652 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-09T08:34:27.660 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-09T08:34:27.662 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-03-09T08:34:27.669 INFO:teuthology.task.internal:Configuring sudo... 2021-03-09T08:34:27.670 DEBUG:teuthology.orchestra.run.smithi091:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-03-09T08:34:27.675 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-03-09T08:34:27.719 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-03-09T08:34:27.730 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-03-09T08:34:27.730 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-03-09T08:34:27.734 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-03-09T08:34:27.770 DEBUG:teuthology.orchestra.run.smithi091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-09T08:34:27.790 DEBUG:teuthology.orchestra.run.smithi091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-09T08:34:27.839 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:34:27.844 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-03-09T08:34:27.907 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-09T08:34:27.914 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-09T08:34:27.961 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:34:27.962 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-03-09T08:34:28.023 DEBUG:teuthology.orchestra.run.smithi091:> sudo service rsyslog restart 2021-03-09T08:34:28.026 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2021-03-09T08:34:28.109 INFO:teuthology.run_tasks:Running task internal.timer... 2021-03-09T08:34:28.121 INFO:teuthology.task.internal:Starting timer... 2021-03-09T08:34:28.121 INFO:teuthology.run_tasks:Running task pcp... 2021-03-09T08:34:28.139 INFO:teuthology.run_tasks:Running task selinux... 2021-03-09T08:34:28.151 DEBUG:teuthology.task.selinux:Excluding smithi091: OS 'ubuntu' does not support SELinux 2021-03-09T08:34:28.151 DEBUG:teuthology.task.selinux:Excluding smithi106: OS 'ubuntu' does not support SELinux 2021-03-09T08:34:28.152 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-03-09T08:34:28.152 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-03-09T08:34:28.152 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-03-09T08:34:28.153 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-03-09T08:34:28.169 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-03-09T08:34:28.173 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-03-09T08:34:28.376 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-03-09T08:34:28.383 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi091.front.sepia.ceph.com,smithi106.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-03-09T08:34:29.736 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-03-09T08:34:32.176 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-03-09T08:34:35.376 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-03-09T08:34:35.451 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:35 +0000 (0:00:00.115) 0:00:00.115 ********* 2021-03-09T08:34:35.477 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:35 +0000 (0:00:00.025) 0:00:00.141 ********* 2021-03-09T08:34:37.171 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-03-09T08:34:37.173 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 18.04 on host smithi106.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi106.front.sepia.ceph.com] 2021-03-09T08:34:37.188 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 18.04 on host smithi091.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi091.front.sepia.ceph.com] 2021-03-09T08:34:37.193 INFO:teuthology.task.ansible.out: 2021-03-09T08:34:37.269 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:37 +0000 (0:00:01.792) 0:00:01.933 ********* 2021-03-09T08:34:37.322 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:37 +0000 (0:00:00.050) 0:00:01.984 ********* 2021-03-09T08:34:37.618 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-03-09T08:34:37.620 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-09T08:34:37.642 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:37 +0000 (0:00:00.321) 0:00:02.306 ********* 2021-03-09T08:34:37.663 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:37 +0000 (0:00:00.020) 0:00:02.327 ********* 2021-03-09T08:34:38.316 INFO:teuthology.task.ansible.out: 2021-03-09T08:34:38.319 INFO:teuthology.task.ansible.out:TASK [ansible-managed : Create the ansible user.] ****************************** changed: [smithi091.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-03-09T08:34:38.343 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:38 +0000 (0:00:00.680) 0:00:03.007 ********* 2021-03-09T08:34:38.345 INFO:teuthology.task.ansible.out: 2021-03-09T08:34:38.379 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-03-09T08:34:38.415 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:38 +0000 (0:00:00.072) 0:00:03.080 ********* 2021-03-09T08:34:38.774 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-03-09T08:34:38.776 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.060889", "end": "2021-03-09 08:34:38.246649", "rc": 0, "start": "2021-03-09 08:34:38.185760", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.073839", "end": "2021-03-09 08:34:39.124085", "rc": 0, "start": "2021-03-09 08:34:39.050246", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-03-09T08:34:38.805 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:38 +0000 (0:00:00.389) 0:00:03.469 ********* 2021-03-09T08:34:38.830 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:38 +0000 (0:00:00.025) 0:00:03.494 ********* 2021-03-09T08:34:39.144 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-03-09T08:34:39.146 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-09T08:34:39.174 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:39 +0000 (0:00:00.343) 0:00:03.838 ********* 2021-03-09T08:34:39.182 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-09T08:34:39.210 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:39 +0000 (0:00:00.036) 0:00:03.874 ********* 2021-03-09T08:34:40.088 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-03-09T08:34:40.090 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615278879.2186103-6339-93701342349145/source", "state": "file", "uid": 0} 2021-03-09T08:34:40.113 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:40 +0000 (0:00:00.902) 0:00:04.777 ********* 2021-03-09T08:34:40.121 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615278879.2743425-6354-272613324654350/source", "state": "file", "uid": 0} 2021-03-09T08:34:40.147 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:40 +0000 (0:00:00.034) 0:00:04.812 ********* 2021-03-09T08:34:40.670 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtC 2021-03-09T08:34:40.672 INFO:teuthology.task.ansible.out:toHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-03-09T08:34:40.693 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-03-09T08:34:40.695 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-03-09T08:34:40.782 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-03-09T08:34:40.785 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-03-09T08:34:40.963 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:40 +0000 (0:00:00.815) 0:00:05.627 ********* 2021-03-09T08:34:41.001 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:40 +0000 (0:00:00.038) 0:00:05.666 ********* 2021-03-09T08:34:41.730 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi091.front.sepia.ceph.com] 2021-03-09T08:34:41.792 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-03-09T08:34:41.794 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:41 +0000 (0:00:00.791) 0:00:06.457 ********* 2021-03-09T08:34:41.806 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] 2021-03-09T08:34:41.866 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:41 +0000 (0:00:00.073) 0:00:06.530 ********* 2021-03-09T08:34:42.278 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-03-09T08:34:42.279 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.178685", "end": "2021-03-09 08:34:42.252880", "rc": 0, "start": "2021-03-09 08:34:42.074195", "stderr": "", "stderr_lines": [], "stdout": "c31004c4720a55ac12a95d66c32e64f592877604", "stdout_lines": ["c31004c4720a55ac12a95d66c32e64f592877604"]} 2021-03-09T08:34:42.303 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:42 +0000 (0:00:00.437) 0:00:06.968 ********* 2021-03-09T08:34:42.311 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.148979", "end": "2021-03-09 08:34:42.273074", "rc": 0, "start": "2021-03-09 08:34:42.124095", "stderr": "", "stderr_lines": [], "stdout": "c31004c4720a55ac12a95d66c32e64f592877604", "stdout_lines": ["c31004c4720a55ac12a95d66c32e64f592877604"]} 2021-03-09T08:34:42.339 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:42 +0000 (0:00:00.035) 0:00:07.003 ********* 2021-03-09T08:34:42.491 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-03-09T08:34:42.493 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.016479", "end": "2021-03-09 08:34:41.978190", "failed_when_result": false, "rc": 0, "start": "2021-03-09 08:34:41.961711", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-03-09T08:34:42.521 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:42 +0000 (0:00:00.181) 0:00:07.185 ********* 2021-03-09T08:34:42.612 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:34:42.636 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:42 +0000 (0:00:00.115) 0:00:07.300 ********* 2021-03-09T08:34:42.716 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-03-09T08:34:42.718 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.281581", "end": "2021-03-09 08:34:43.074250", "failed_when_result": false, "rc": 0, "start": "2021-03-09 08:34:42.792669", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:34:42.745 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:42 +0000 (0:00:00.109) 0:00:07.410 ********* 2021-03-09T08:34:42.771 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:42 +0000 (0:00:00.025) 0:00:07.436 ********* 2021-03-09T08:34:42.826 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-03-09T08:34:42.828 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:34:42.852 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:42 +0000 (0:00:00.080) 0:00:07.517 ********* 2021-03-09T08:34:42.871 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-03-09T08:34:42.872 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:34:42.896 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:42 +0000 (0:00:00.044) 0:00:07.561 ********* 2021-03-09T08:34:42.939 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-03-09T08:34:42.941 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:34:42.972 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:42 +0000 (0:00:00.075) 0:00:07.636 ********* 2021-03-09T08:34:43.000 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-03-09T08:34:43.001 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:34:43.025 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:43 +0000 (0:00:00.053) 0:00:07.690 ********* 2021-03-09T08:34:43.105 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-03-09T08:34:43.107 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:34:43.144 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:43 +0000 (0:00:00.118) 0:00:07.808 ********* 2021-03-09T08:34:43.151 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-03-09T08:34:43.153 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:34:43.179 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:43 +0000 (0:00:00.034) 0:00:07.843 ********* 2021-03-09T08:34:43.227 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-03-09T08:34:43.229 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:34:43.252 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:43 +0000 (0:00:00.073) 0:00:07.916 ********* 2021-03-09T08:34:43.334 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:34:43.359 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:43 +0000 (0:00:00.107) 0:00:08.024 ********* 2021-03-09T08:34:43.377 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-03-09T08:34:43.379 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-09T08:34:43.410 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:43 +0000 (0:00:00.050) 0:00:08.074 ********* 2021-03-09T08:34:43.558 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-09T08:34:43.591 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:34:43 +0000 (0:00:00.181) 0:00:08.256 ********* 2021-03-09T08:34:43.693 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-09T08:34:43.695 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-03-09T08:34:43.853 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-03-09T08:34:43.886 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-03-09T08:34:44.037 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-03-09T08:34:44.048 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-03-09T08:34:44.269 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-03-09T08:34:44.736 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f 2021-03-09T08:34:44.737 INFO:teuthology.task.ansible.out:5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", 2021-03-09T08:34:44.739 INFO:teuthology.task.ansible.out: "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-03-09T08:34:44.886 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-03-09T08:34:44.888 INFO:teuthology.task.ansible.out: 2021-03-09T08:34:44.893 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-03-09T08:34:45.086 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-03-09T08:34:45.108 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-03-09T08:34:45.259 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-03-09T08:34:45.292 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-03-09T08:34:45.451 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-03-09T08:34:45.507 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-03-09T08:34:45.613 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-03-09T08:34:45.698 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-03-09T08:34:45.791 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-03-09T08:34:45.897 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-03-09T08:34:45.951 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-03-09T08:34:46.068 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-03-09T08:34:46.111 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-03-09T08:34:46.210 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-03-09T08:34:46.264 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-03-09T08:34:46.351 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-03-09T08:34:46.405 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-03-09T08:34:46.511 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-03-09T08:34:46.555 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-03-09T08:34:46.672 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-03-09T08:34:46.706 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-03-09T08:34:46.813 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-03-09T08:34:46.857 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-03-09T08:34:46.997 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-03-09T08:34:47.032 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-03-09T08:34:47.172 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-03-09T08:34:47.184 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-03-09T08:34:47.327 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-03-09T08:34:47.483 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-03-09T08:34:47.495 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-03-09T08:34:47.643 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-03-09T08:34:47.644 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-03-09T08:34:47.794 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-03-09T08:34:47.795 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-03-09T08:34:47.942 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-03-09T08:34:47.943 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-03-09T08:34:48.109 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-03-09T08:34:48.120 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-03-09T08:34:48.271 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-03-09T08:34:48.300 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-03-09T08:34:48.419 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-03-09T08:34:48.421 INFO:teuthology.task.ansible.out: 2021-03-09T08:34:48.441 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-03-09T08:34:48.570 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-03-09T08:34:48.607 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-03-09T08:34:48.715 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-03-09T08:34:48.747 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-03-09T08:34:48.863 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-03-09T08:34:48.907 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-03-09T08:34:49.025 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-03-09T08:34:49.058 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-03-09T08:34:49.177 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-03-09T08:34:49.210 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-03-09T08:34:49.327 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-03-09T08:34:49.360 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-03-09T08:34:49.511 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-03-09T08:34:49.533 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-03-09T08:34:49.662 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-03-09T08:34:49.692 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-03-09T08:34:49.822 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-03-09T08:34:49.844 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-03-09T08:34:49.971 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-03-09T08:34:50.004 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-03-09T08:34:50.155 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-09T08:34:50.167 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-09T08:34:50.319 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-09T08:34:50.331 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-09T08:34:50.469 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-03-09T08:34:50.481 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-03-09T08:34:50.624 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-03-09T08:34:50.651 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-03-09T08:34:50.802 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-03-09T08:34:50.814 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-03-09T08:34:50.954 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-03-09T08:34:50.983 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-03-09T08:34:51.114 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-03-09T08:34:51.147 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-03-09T08:34:51.276 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-03-09T08:34:51.298 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-03-09T08:34:51.425 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-09T08:34:51.449 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-09T08:34:51.577 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-09T08:34:51.600 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-09T08:34:51.739 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-03-09T08:34:51.750 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-03-09T08:34:51.893 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-03-09T08:34:51.905 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-03-09T08:34:52.042 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-03-09T08:34:52.054 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-03-09T08:34:52.195 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-03-09T08:34:52.206 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-03-09T08:34:52.365 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-03-09T08:34:52.387 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-03-09T08:34:52.531 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-03-09T08:34:52.554 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-03-09T08:34:52.701 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-03-09T08:34:52.725 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-03-09T08:34:52.852 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-03-09T08:34:52.865 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-03-09T08:34:53.003 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-03-09T08:34:53.015 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-03-09T08:34:53.174 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-03-09T08:34:53.187 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-03-09T08:34:53.315 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-03-09T08:34:53.327 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-03-09T08:34:53.465 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-03-09T08:34:53.477 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-03-09T08:34:53.615 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-03-09T08:34:53.617 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-03-09T08:34:53.757 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-03-09T08:34:53.769 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-03-09T08:34:53.896 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-03-09T08:34:53.918 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-03-09T08:34:54.066 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-09T08:34:54.150 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-09T08:34:54.226 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-03-09T08:34:54.300 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-03-09T08:34:54.387 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-03-09T08:34:54.463 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-03-09T08:34:54.550 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-03-09T08:34:54.637 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-03-09T08:34:54.693 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-03-09T08:34:54.811 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-03-09T08:34:54.844 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-03-09T08:34:54.961 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-03-09T08:34:55.003 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-03-09T08:34:55.107 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-03-09T08:34:55.170 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-03-09T08:34:55.256 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-03-09T08:34:55.321 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-03-09T08:34:55.418 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-03-09T08:34:55.472 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-03-09T08:34:55.557 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-03-09T08:34:55.621 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-03-09T08:34:55.707 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-03-09T08:34:55.773 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-03-09T08:34:55.859 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-03-09T08:34:55.916 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-03-09T08:34:56.023 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-03-09T08:34:56.066 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-03-09T08:34:56.163 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-03-09T08:34:56.210 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-03-09T08:34:56.328 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-03-09T08:34:56.372 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-03-09T08:34:56.494 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-03-09T08:34:56.527 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-03-09T08:34:56.660 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-03-09T08:34:56.694 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-03-09T08:34:56.810 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-03-09T08:34:56.844 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-03-09T08:34:57.003 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-03-09T08:34:57.013 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-03-09T08:34:57.220 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-03-09T08:34:57.312 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-03-09T08:34:57.468 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-03-09T08:34:57.470 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-03-09T08:34:57.694 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-03-09T08:34:57.696 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-03-09T08:34:57.937 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-03-09T08:34:57.949 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-03-09T08:34:58.194 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-03-09T08:34:58.198 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-03-09T08:34:58.378 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-03-09T08:34:58.390 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-03-09T08:34:58.551 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-03-09T08:34:58.553 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-03-09T08:34:58.715 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-03-09T08:34:58.737 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-03-09T08:34:58.739 INFO:teuthology.task.ansible.out: 2021-03-09T08:34:58.908 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-03-09T08:34:58.909 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-03-09T08:34:59.073 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-03-09T08:34:59.074 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-03-09T08:34:59.254 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-03-09T08:34:59.256 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-03-09T08:34:59.408 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-03-09T08:34:59.410 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-03-09T08:34:59.564 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-03-09T08:34:59.573 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-03-09T08:34:59.725 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-03-09T08:34:59.726 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-03-09T08:34:59.887 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-03-09T08:34:59.899 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-03-09T08:35:00.060 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-03-09T08:35:00.062 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-03-09T08:35:00.199 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-03-09T08:35:00.221 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-03-09T08:35:00.360 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-03-09T08:35:00.372 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-03-09T08:35:00.511 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-03-09T08:35:00.523 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-09T08:35:00.661 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-09T08:35:00.685 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-03-09T08:35:00.812 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-03-09T08:35:00.824 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-03-09T08:35:00.951 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-03-09T08:35:00.973 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-03-09T08:35:01.111 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-03-09T08:35:01.123 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-03-09T08:35:01.271 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-03-09T08:35:01.303 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-03-09T08:35:01.430 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-03-09T08:35:01.452 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-03-09T08:35:01.580 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-03-09T08:35:01.602 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-03-09T08:35:01.734 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-03-09T08:35:01.754 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-03-09T08:35:01.877 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-03-09T08:35:01.932 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-03-09T08:35:02.028 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-03-09T08:35:02.083 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-03-09T08:35:02.189 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-03-09T08:35:02.233 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-03-09T08:35:02.328 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-03-09T08:35:02.395 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-03-09T08:35:02.480 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-03-09T08:35:02.535 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-03-09T08:35:02.643 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-03-09T08:35:02.707 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-03-09T08:35:02.803 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-03-09T08:35:02.846 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-03-09T08:35:02.942 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-03-09T08:35:03.008 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-03-09T08:35:03.094 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-03-09T08:35:03.150 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-03-09T08:35:03.256 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-03-09T08:35:03.300 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-03-09T08:35:03.396 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-03-09T08:35:03.450 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-03-09T08:35:03.555 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-03-09T08:35:03.588 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-03-09T08:35:03.696 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-03-09T08:35:03.740 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-03-09T08:35:03.836 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-03-09T08:35:03.900 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-03-09T08:35:03.902 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:03.986 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-03-09T08:35:04.040 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-03-09T08:35:04.136 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-03-09T08:35:04.138 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:04.182 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-03-09T08:35:04.288 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-03-09T08:35:04.332 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-03-09T08:35:04.438 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-03-09T08:35:04.492 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-03-09T08:35:04.587 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-03-09T08:35:04.641 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-03-09T08:35:04.769 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-03-09T08:35:04.792 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-03-09T08:35:05.004 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-03-09T08:35:05.005 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-03-09T08:35:05.167 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-03-09T08:35:05.312 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-03-09T08:35:05.313 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-03-09T08:35:05.463 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-03-09T08:35:05.464 INFO:teuthology.task.ansible.out: ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-03-09T08:35:05.613 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-03-09T08:35:05.761 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-03-09T08:35:05.794 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-03-09T08:35:05.900 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-03-09T08:35:05.935 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-03-09T08:35:06.051 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-03-09T08:35:06.084 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-03-09T08:35:06.201 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-03-09T08:35:06.233 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-03-09T08:35:06.237 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:06.350 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-03-09T08:35:06.393 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-03-09T08:35:06.623 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-03-09T08:35:06.799 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:06 +0000 (0:00:23.207) 0:00:31.463 ********* 2021-03-09T08:35:06.901 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:06 +0000 (0:00:00.032) 0:00:31.496 ********* 2021-03-09T08:35:06.903 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-03-09T08:35:06.930 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:06 +0000 (0:00:00.098) 0:00:31.594 ********* 2021-03-09T08:35:06.965 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:06 +0000 (0:00:00.035) 0:00:31.630 ********* 2021-03-09T08:35:07.049 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:07.051 INFO:teuthology.task.ansible.out:TASK [Merge managed_users and managed_admin users] ***************************** 2021-03-09T08:35:07.051 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68 2021-03-09T08:35:07.053 INFO:teuthology.task.ansible.out:c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali 2021-03-09T08:35:07.054 INFO:teuthology.task.ansible.out:@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273a 2021-03-09T08:35:07.056 INFO:teuthology.task.ansible.out:fed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd 2021-03-09T08:35:07.057 INFO:teuthology.task.ansible.out:5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d903768 2021-03-09T08:35:07.059 INFO:teuthology.task.ansible.out:39dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarz 2021-03-09T08:35:07.060 INFO:teuthology.task.ansible.out:ynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkog 2021-03-09T08:35:07.062 INFO:teuthology.task.ansible.out:an@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSC 2021-03-09T08:35:07.063 INFO:teuthology.task.ansible.out:INdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, 2021-03-09T08:35:07.070 INFO:teuthology.task.ansible.out:{"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": 2021-03-09T08:35:07.082 INFO:teuthology.task.ansible.out:"gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3 2021-03-09T08:35:07.096 INFO:teuthology.task.ansible.out:"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf746 2021-03-09T08:35:07.099 INFO:teuthology.task.ansible.out:5f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomo 2021-03-09T08:35:07.103 INFO:teuthology.task.ansible.out:n", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} Tuesday 09 March 2021 08:35:07 +0000 (0:00:00.136) 0:00:31.767 ********* 2021-03-09T08:35:07.128 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-03-09T08:35:07.130 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-03-09T08:35:07.132 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-03-09T08:35:07.133 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-03-09T08:35:07.135 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 2021-03-09T08:35:07.137 INFO:teuthology.task.ansible.out: 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@l 2021-03-09T08:35:07.145 INFO:teuthology.task.ansible.out:aptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride 2021-03-09T08:35:07.148 INFO:teuthology.task.ansible.out: eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e07 2021-03-09T08:35:07.149 INFO:teuthology.task.ansible.out:4f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": 2021-03-09T08:35:07.151 INFO:teuthology.task.ansible.out: "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6o 2021-03-09T08:35:07.152 INFO:teuthology.task.ansible.out:kqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakM 2021-03-09T08:35:07.154 INFO:teuthology.task.ansible.out:EEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": 2021-03-09T08:35:07.159 INFO:teuthology.task.ansible.out: "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-noteboo 2021-03-09T08:35:07.160 INFO:teuthology.task.ansible.out:k LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXve 2021-03-09T08:35:07.162 INFO:teuthology.task.ansible.out:Jw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-03-09T08:35:07.194 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:07 +0000 (0:00:00.091) 0:00:31.858 ********* 2021-03-09T08:35:07.196 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:08.522 INFO:teuthology.task.ansible.out:FAILED - RETRYING: Clone the keys repo (5 retries left). 2021-03-09T08:35:08.565 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-03-09T08:35:08.567 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"after": "c31004c4720a55ac12a95d66c32e64f592877604", "attempts": 1, "before": "c31004c4720a55ac12a95d66c32e64f592877604", "changed": false, "remote_url_changed": false} 2021-03-09T08:35:08.591 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:08 +0000 (0:00:01.396) 0:00:33.255 ********* 2021-03-09T08:35:09.087 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:09.089 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-03-09T08:35:09.207 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-03-09T08:35:09.410 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-03-09T08:35:09.412 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:09.599 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-03-09T08:35:09.601 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-03-09T08:35:09.786 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-03-09T08:35:09.967 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-03-09T08:35:09.982 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-03-09T08:35:10.159 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-03-09T08:35:10.161 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:10.344 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-03-09T08:35:10.545 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-03-09T08:35:10.547 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:10.752 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-03-09T08:35:10.755 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-03-09T08:35:10.923 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-03-09T08:35:10.925 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-03-09T08:35:10.935 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:10.947 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:11.111 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-03-09T08:35:11.238 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-03-09T08:35:11.241 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-03-09T08:35:11.397 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-03-09T08:35:11.565 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-03-09T08:35:11.567 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-03-09T08:35:11.714 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-03-09T08:35:11.864 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-03-09T08:35:12.020 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-03-09T08:35:12.180 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-03-09T08:35:12.182 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-03-09T08:35:12.351 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-03-09T08:35:12.352 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-03-09T08:35:12.481 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-03-09T08:35:12.631 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-03-09T08:35:12.790 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-03-09T08:35:12.792 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-03-09T08:35:12.945 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-03-09T08:35:13.083 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-03-09T08:35:13.235 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-03-09T08:35:13.372 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-03-09T08:35:13.510 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-03-09T08:35:13.646 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-03-09T08:35:13.648 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-03-09T08:35:13.773 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-03-09T08:35:13.910 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-03-09T08:35:14.038 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-03-09T08:35:14.185 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-03-09T08:35:14.312 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-03-09T08:35:14.450 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-03-09T08:35:14.578 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-09T08:35:14.705 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-03-09T08:35:14.853 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-03-09T08:35:14.980 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-03-09T08:35:14.982 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-03-09T08:35:15.117 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-03-09T08:35:15.118 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-03-09T08:35:15.262 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-03-09T08:35:15.389 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-03-09T08:35:15.527 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-03-09T08:35:15.665 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-03-09T08:35:15.666 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-09T08:35:15.802 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-03-09T08:35:15.804 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-03-09T08:35:15.806 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-03-09T08:35:15.930 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-03-09T08:35:16.068 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-03-09T08:35:16.196 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-03-09T08:35:16.333 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-03-09T08:35:16.471 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-03-09T08:35:16.472 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:16.603 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-03-09T08:35:16.605 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-03-09T08:35:16.740 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-03-09T08:35:16.888 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-03-09T08:35:17.026 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-03-09T08:35:17.028 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-03-09T08:35:17.152 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-03-09T08:35:17.290 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-03-09T08:35:17.429 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-03-09T08:35:17.431 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-03-09T08:35:17.569 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-03-09T08:35:17.790 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-03-09T08:35:17.980 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-03-09T08:35:17.981 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:18.181 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-09T08:35:18.341 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-03-09T08:35:18.467 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-03-09T08:35:18.601 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-03-09T08:35:18.740 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-03-09T08:35:18.898 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-03-09T08:35:19.027 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-03-09T08:35:19.164 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-03-09T08:35:19.291 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-03-09T08:35:19.439 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-03-09T08:35:19.579 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-03-09T08:35:19.714 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-03-09T08:35:19.716 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"after": "c31004c4720a55ac12a95d66c32e64f592877604", "attempts": 2, "before": "c31004c4720a55ac12a95d66c32e64f592877604", "changed": false, "remote_url_changed": false} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-03-09T08:35:19.742 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:19 +0000 (0:00:11.151) 0:00:44.406 ********* 2021-03-09T08:35:19.854 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-03-09T08:35:19.987 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-03-09T08:35:20.083 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-03-09T08:35:20.137 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-03-09T08:35:20.276 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-03-09T08:35:20.374 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-03-09T08:35:20.438 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-03-09T08:35:20.588 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-03-09T08:35:20.642 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-03-09T08:35:20.645 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-03-09T08:35:20.767 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-03-09T08:35:20.769 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-03-09T08:35:20.806 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-03-09T08:35:20.961 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-03-09T08:35:20.973 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-03-09T08:35:20.975 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-03-09T08:35:21.175 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-03-09T08:35:21.196 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-03-09T08:35:21.354 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-03-09T08:35:21.401 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-03-09T08:35:21.558 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-03-09T08:35:21.601 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-03-09T08:35:21.623 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:21.729 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-03-09T08:35:21.731 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-03-09T08:35:21.815 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-03-09T08:35:21.817 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-03-09T08:35:21.891 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-03-09T08:35:21.893 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-03-09T08:35:21.987 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-03-09T08:35:21.989 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-03-09T08:35:22.000 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:22.011 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:22.046 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-03-09T08:35:22.184 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-03-09T08:35:22.212 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-03-09T08:35:22.329 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-03-09T08:35:22.330 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-03-09T08:35:22.353 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-03-09T08:35:22.480 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-03-09T08:35:22.492 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-03-09T08:35:22.631 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-03-09T08:35:22.633 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-03-09T08:35:22.635 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-03-09T08:35:22.773 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-03-09T08:35:22.804 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-03-09T08:35:22.933 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-03-09T08:35:22.946 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-03-09T08:35:23.086 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-03-09T08:35:23.088 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-03-09T08:35:23.218 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-03-09T08:35:23.219 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-03-09T08:35:23.221 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-03-09T08:35:23.365 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-03-09T08:35:23.367 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-03-09T08:35:23.376 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-03-09T08:35:23.494 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-03-09T08:35:23.517 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-03-09T08:35:23.644 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-03-09T08:35:23.645 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-03-09T08:35:23.783 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-03-09T08:35:23.796 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-03-09T08:35:23.798 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-03-09T08:35:23.919 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-03-09T08:35:23.951 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-03-09T08:35:24.048 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-03-09T08:35:24.050 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-09T08:35:24.092 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-03-09T08:35:24.209 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-03-09T08:35:24.231 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-03-09T08:35:24.343 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-03-09T08:35:24.378 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-03-09T08:35:24.495 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-03-09T08:35:24.527 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-03-09T08:35:24.645 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-03-09T08:35:24.656 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-03-09T08:35:24.658 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-03-09T08:35:24.783 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-03-09T08:35:24.794 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-03-09T08:35:24.921 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-03-09T08:35:24.925 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-03-09T08:35:25.070 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-03-09T08:35:25.072 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-03-09T08:35:25.220 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-03-09T08:35:25.231 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-03-09T08:35:25.362 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-03-09T08:35:25.384 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-03-09T08:35:25.518 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-03-09T08:35:25.542 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-03-09T08:35:25.676 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-09T08:35:25.720 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-03-09T08:35:25.847 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-03-09T08:35:25.901 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-03-09T08:35:26.015 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-03-09T08:35:26.064 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-03-09T08:35:26.176 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-03-09T08:35:26.178 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-03-09T08:35:26.240 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-03-09T08:35:26.367 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-03-09T08:35:26.370 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-03-09T08:35:26.411 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-03-09T08:35:26.520 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-03-09T08:35:26.564 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-03-09T08:35:26.676 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-03-09T08:35:26.730 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-03-09T08:35:26.872 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-03-09T08:35:26.891 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-03-09T08:35:27.023 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-03-09T08:35:27.025 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-09T08:35:27.054 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-03-09T08:35:27.056 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-03-09T08:35:27.161 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-03-09T08:35:27.163 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-03-09T08:35:27.164 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-03-09T08:35:27.204 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-03-09T08:35:27.328 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-03-09T08:35:27.340 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-03-09T08:35:27.488 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-03-09T08:35:27.490 INFO:teuthology.task.ansible.out: ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-03-09T08:35:27.617 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-03-09T08:35:27.619 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-03-09T08:35:27.620 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:27.773 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-03-09T08:35:27.777 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-03-09T08:35:27.947 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-03-09T08:35:27.982 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-03-09T08:35:28.089 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-03-09T08:35:28.132 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-03-09T08:35:28.134 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-03-09T08:35:28.229 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-03-09T08:35:28.272 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-03-09T08:35:28.369 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-03-09T08:35:28.455 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-03-09T08:35:28.501 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-03-09T08:35:28.607 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-03-09T08:35:28.609 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-03-09T08:35:28.629 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-03-09T08:35:28.747 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-03-09T08:35:28.788 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-03-09T08:35:29.240 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs" 2021-03-09T08:35:29.242 INFO:teuthology.task.ansible.out:: true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7 2021-03-09T08:35:29.243 INFO:teuthology.task.ansible.out:VYdDS33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUA 2021-03-09T08:35:29.245 INFO:teuthology.task.ansible.out:rGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-03-09T08:35:29.268 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-03-09T08:35:29.290 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-03-09T08:35:29.413 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-03-09T08:35:29.436 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-03-09T08:35:29.552 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-03-09T08:35:29.553 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_options" 2021-03-09T08:35:29.554 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-03-09T08:35:29.684 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-09T08:35:29.695 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-03-09T08:35:29.813 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:29 +0000 (0:00:10.071) 0:00:54.478 ********* 2021-03-09T08:35:29.835 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-03-09T08:35:29.952 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-09T08:35:29.954 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:29.965 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:29.976 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:29.977 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6 2021-03-09T08:35:29.979 INFO:teuthology.task.ansible.out:upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:29.988 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.010 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.011 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.021 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.118 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:30.119 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-03-09T08:35:30.161 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-09T08:35:30.164 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-03-09T08:35:30.173 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.175 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.258 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:30.261 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-03-09T08:35:30.312 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-09T08:35:30.314 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-03-09T08:35:30.410 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:30.412 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-03-09T08:35:30.442 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:30.444 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi091.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-03-09T08:35:30.456 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.457 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:30.467 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.478 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.480 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.490 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.492 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.502 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.513 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.515 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.525 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.526 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.538 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.548 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.549 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:30.549 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-03-09T08:35:30.550 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:30.551 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.562 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.564 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:30.565 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.576 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.578 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.588 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.599 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.601 INFO:teuthology.task.ansible.out: skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.612 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.623 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.634 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.635 INFO:teuthology.task.ansible.out: skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.637 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.648 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.651 INFO:teuthology.task.ansible.out: skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.662 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.663 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.675 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.676 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-03-09T08:35:30.677 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.688 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.699 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.701 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.711 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.713 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.722 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.724 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.734 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.736 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.746 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.757 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.759 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.769 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.770 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.780 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.791 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.794 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.803 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.805 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.815 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.826 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:30.828 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.828 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name' 2021-03-09T08:35:30.830 INFO:teuthology.task.ansible.out:: 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.839 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.851 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.852 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.862 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.864 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.874 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.885 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.886 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.897 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.908 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.910 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.919 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.930 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.932 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.942 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.944 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.954 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:30.956 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.967 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.968 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:30.990 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.002 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.014 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.017 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.026 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.038 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.040 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.050 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.061 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.063 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.073 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.084 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.085 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.095 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.107 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:31.108 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8 2021-03-09T08:35:31.110 INFO:teuthology.task.ansible.out:432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.119 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.135 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.142 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.153 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.155 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:31.165 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.168 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.184 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.188 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.190 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:31.191 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.207 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.208 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.212 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.213 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.232 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.234 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.245 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.246 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.263 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.264 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.265 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.277 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.279 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.293 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:31.298 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:31.299 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-03-09T08:35:31.301 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-09T08:35:31.303 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.313 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.325 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.407 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:31 +0000 (0:00:01.594) 0:00:56.072 ********* 2021-03-09T08:35:31.490 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:31.492 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-03-09T08:35:31.513 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:31.537 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:31 +0000 (0:00:00.129) 0:00:56.202 ********* 2021-03-09T08:35:31.700 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:31.701 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-03-09T08:35:31.874 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:31.876 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-03-09T08:35:31.917 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:31.919 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-03-09T08:35:32.067 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi091.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-03-09T08:35:32.088 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:32.093 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-03-09T08:35:32.255 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:32.257 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-03-09T08:35:32.439 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:32.441 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-03-09T08:35:32.450 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:32.452 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-03-09T08:35:32.454 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-03-09T08:35:32.589 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:32.591 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-03-09T08:35:32.611 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:32.613 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-03-09T08:35:32.738 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi091.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-03-09T08:35:32.750 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:32.751 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-03-09T08:35:32.868 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:32.870 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-03-09T08:35:32.891 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:32.892 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-03-09T08:35:33.018 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:33.020 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-03-09T08:35:33.030 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:33.031 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-03-09T08:35:33.170 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-03-09T08:35:33.172 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [smithi091.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-03-09T08:35:33.309 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-03-09T08:35:33.311 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08R 2021-03-09T08:35:33.313 INFO:teuthology.task.ansible.out:rDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-03-09T08:35:33.438 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-03-09T08:35:33.440 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi091.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-03-09T08:35:33.590 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:33.592 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [smithi091.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-03-09T08:35:33.740 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-03-09T08:35:33.742 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-03-09T08:35:33.885 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-03-09T08:35:33.886 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:33.887 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-03-09T08:35:34.026 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-03-09T08:35:34.037 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:34.039 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-03-09T08:35:34.166 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:34.168 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:34.168 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-03-09T08:35:34.298 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-03-09T08:35:34.300 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:34.300 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-03-09T08:35:34.451 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:34.453 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-03-09T08:35:34.455 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [smithi091.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-03-09T08:35:34.583 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:34.585 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-03-09T08:35:34.595 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:34.597 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-03-09T08:35:34.726 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:34.728 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-03-09T08:35:34.749 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:34.750 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-03-09T08:35:34.857 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:34.860 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-03-09T08:35:34.892 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:34.895 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-03-09T08:35:35.002 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:35.004 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-03-09T08:35:35.035 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:35.037 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-03-09T08:35:35.142 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:35.144 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-03-09T08:35:35.185 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:35.187 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-03-09T08:35:35.292 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:35.293 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-03-09T08:35:35.314 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:35.315 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-03-09T08:35:35.446 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:35.449 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-03-09T08:35:35.450 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-09T08:35:35.469 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:35.470 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-03-09T08:35:35.617 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:35.618 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-03-09T08:35:35.628 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:35.630 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-03-09T08:35:35.799 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-03-09T08:35:35.800 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-03-09T08:35:35.945 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-03-09T08:35:35.946 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:35.970 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi091.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-03-09T08:35:36.107 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:36.109 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-03-09T08:35:36.129 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:36.131 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-03-09T08:35:36.247 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:36.248 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-03-09T08:35:36.269 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:36.271 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-03-09T08:35:36.385 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:36.387 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-03-09T08:35:36.410 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:36.412 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-03-09T08:35:36.527 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:36.528 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-03-09T08:35:36.559 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:36.561 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-03-09T08:35:36.679 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:36.681 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-03-09T08:35:36.701 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:36.702 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-03-09T08:35:36.817 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:36.819 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-03-09T08:35:36.839 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:36.842 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-03-09T08:35:36.968 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:36.969 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-03-09T08:35:36.990 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:36.991 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-03-09T08:35:37.099 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:37.101 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-03-09T08:35:37.132 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:37.133 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-03-09T08:35:37.249 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:37.251 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-03-09T08:35:37.282 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:37.283 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-03-09T08:35:37.399 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:37.401 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-03-09T08:35:37.424 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:37.426 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-03-09T08:35:37.551 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-03-09T08:35:37.584 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:37.585 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-03-09T08:35:37.679 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:37.681 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-03-09T08:35:37.722 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:37.724 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-03-09T08:35:37.831 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-03-09T08:35:37.833 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:37.864 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:37.866 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-03-09T08:35:37.971 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:37.973 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-03-09T08:35:38.014 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:38.015 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-03-09T08:35:38.109 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:38.111 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-03-09T08:35:38.163 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:38.165 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-03-09T08:35:38.248 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:38.250 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-03-09T08:35:38.252 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-03-09T08:35:38.301 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:38.304 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-03-09T08:35:38.387 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:38.389 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-03-09T08:35:38.451 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:38.453 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-03-09T08:35:38.515 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:38.517 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-03-09T08:35:38.579 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:38.581 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-03-09T08:35:38.664 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:38.666 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-03-09T08:35:38.718 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:38.719 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-03-09T08:35:38.795 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:38.797 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-03-09T08:35:38.860 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi091.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-03-09T08:35:38.941 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:38.943 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-03-09T08:35:39.006 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi091.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-03-09T08:35:39.063 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:39 +0000 (0:00:07.525) 0:01:03.727 ********* 2021-03-09T08:35:39.081 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:39.083 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-03-09T08:35:39.200 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-03-09T08:35:39.339 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-03-09T08:35:39.478 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-03-09T08:35:39.633 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "checksum": "1d9711ff879c231c67cb70d00ca0088797a377d0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "80a55def4b505d08aff3687f81f74dc2", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615278939.1612265-14448-240669214433164/source", "state": "file", "uid": 0} Tuesday 09 March 2021 08:35:39 +0000 (0:00:00.516) 0:01:04.244 ********* 2021-03-09T08:35:39.702 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-03-09T08:35:39.704 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => { "msg": "Host smithi091.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-03-09T08:35:39.727 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:39 +0000 (0:00:00.147) 0:01:04.391 ********* 2021-03-09T08:35:39.736 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:39.738 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-03-09T08:35:39.888 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi091.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-03-09T08:35:39.912 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:39 +0000 (0:00:00.185) 0:01:04.576 ********* 2021-03-09T08:35:39.929 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:39.931 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-03-09T08:35:39.993 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:40.017 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:40 +0000 (0:00:00.104) 0:01:04.681 ********* 2021-03-09T08:35:40.076 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:40.078 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-03-09T08:35:40.099 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:40.123 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:40 +0000 (0:00:00.105) 0:01:04.787 ********* 2021-03-09T08:35:40.206 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-03-09T08:35:40.208 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-03-09T08:35:40.232 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:40 +0000 (0:00:00.109) 0:01:04.897 ********* 2021-03-09T08:35:40.305 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:40.328 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:40 +0000 (0:00:00.095) 0:01:04.993 ********* 2021-03-09T08:35:40.346 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:40.347 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-03-09T08:35:40.434 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:40.456 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:40 +0000 (0:00:00.127) 0:01:05.120 ********* 2021-03-09T08:35:40.506 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:40.508 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-03-09T08:35:40.539 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:40.566 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:40 +0000 (0:00:00.110) 0:01:05.231 ********* 2021-03-09T08:35:40.647 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-03-09T08:35:40.649 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:40.678 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:40 +0000 (0:00:00.111) 0:01:05.343 ********* 2021-03-09T08:35:40.686 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:40.687 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-03-09T08:35:40.773 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-03-09T08:35:40.777 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:40.797 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:40 +0000 (0:00:00.119) 0:01:05.462 ********* 2021-03-09T08:35:40.804 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-09T08:35:40.806 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_options" 2021-03-09T08:35:40.807 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-03-09T08:35:40.879 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-03-09T08:35:40.881 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi091.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-09T08:35:40.906 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:40 +0000 (0:00:00.108) 0:01:05.570 ********* 2021-03-09T08:35:40.927 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-03-09T08:35:41.027 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-03-09T08:35:41.028 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.050 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:41 +0000 (0:00:00.144) 0:01:05.715 ********* 2021-03-09T08:35:41.052 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:41.076 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:41 +0000 (0:00:00.025) 0:01:05.741 ********* 2021-03-09T08:35:41.078 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:41.144 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-03-09T08:35:41.146 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.175 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:41 +0000 (0:00:00.098) 0:01:05.839 ********* 2021-03-09T08:35:41.239 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.250 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.261 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.272 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.284 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.286 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi091.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-09T08:35:41.312 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:41 +0000 (0:00:00.136) 0:01:05.976 ********* 2021-03-09T08:35:41.322 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-09T08:35:41.323 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.324 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.448 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.474 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:41 +0000 (0:00:00.162) 0:01:06.139 ********* 2021-03-09T08:35:41.507 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-09T08:35:41.509 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e 2021-03-09T08:35:41.511 INFO:teuthology.task.ansible.out:1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.574 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi091.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-09T08:35:41.598 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:41 +0000 (0:00:00.123) 0:01:06.262 ********* 2021-03-09T08:35:41.627 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-09T08:35:41.629 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-03-09T08:35:41.672 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.699 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:41 +0000 (0:00:00.101) 0:01:06.364 ********* 2021-03-09T08:35:41.759 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-09T08:35:41.761 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfad 2021-03-09T08:35:41.763 INFO:teuthology.task.ansible.out:a28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.772 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.774 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.796 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:41 +0000 (0:00:00.097) 0:01:06.461 ********* 2021-03-09T08:35:41.805 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-09T08:35:41.806 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.807 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.808 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.810 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.821 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.823 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.834 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.836 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.846 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.857 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.859 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.869 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.872 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.882 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.884 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.908 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:41 +0000 (0:00:00.111) 0:01:06.572 ********* 2021-03-09T08:35:41.916 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.917 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.919 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:41.920 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.922 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.924 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.934 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.937 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.949 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.951 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.966 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.968 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.979 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.990 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:41.992 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.020 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:42 +0000 (0:00:00.111) 0:01:06.684 ********* 2021-03-09T08:35:42.028 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.033 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.035 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.036 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.040 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.053 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.055 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.065 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.079 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.087 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.099 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.101 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.110 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.112 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi091.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.144 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:42 +0000 (0:00:00.124) 0:01:06.809 ********* 2021-03-09T08:35:42.168 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.170 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.171 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.178 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.181 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.183 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.198 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.205 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.216 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.219 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.227 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.230 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.239 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.250 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.258 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.268 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.288 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7 2021-03-09T08:35:42.291 INFO:teuthology.task.ansible.out:ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.302 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.322 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:42 +0000 (0:00:00.177) 0:01:06.986 ********* 2021-03-09T08:35:42.399 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-09T08:35:42.403 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.417 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.421 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.422 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.426 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.438 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.457 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.460 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.475 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.478 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.498 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.504 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.505 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:42.506 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.507 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.508 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.510 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.511 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.513 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.515 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.516 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.518 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.543 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:42 +0000 (0:00:00.221) 0:01:07.208 ********* 2021-03-09T08:35:42.552 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.554 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.556 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.568 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.580 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.591 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.603 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.614 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.626 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.637 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.649 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.660 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.671 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.683 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.693 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.695 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.718 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:42 +0000 (0:00:00.174) 0:01:07.383 ********* 2021-03-09T08:35:42.727 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.729 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.771 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:42 +0000 (0:00:00.052) 0:01:07.436 ********* 2021-03-09T08:35:42.830 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-03-09T08:35:42.832 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.872 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:42 +0000 (0:00:00.099) 0:01:07.535 ********* 2021-03-09T08:35:42.885 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-03-09T08:35:42.886 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:42.932 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:42 +0000 (0:00:00.060) 0:01:07.596 ********* 2021-03-09T08:35:42.982 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-03-09T08:35:42.984 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:43.007 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:43 +0000 (0:00:00.075) 0:01:07.672 ********* 2021-03-09T08:35:43.087 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-03-09T08:35:43.089 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:43.112 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:43 +0000 (0:00:00.104) 0:01:07.776 ********* 2021-03-09T08:35:43.203 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-03-09T08:35:43.204 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-09T08:35:43.227 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:43 +0000 (0:00:00.115) 0:01:07.892 ********* 2021-03-09T08:35:43.276 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:43.278 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-03-09T08:35:43.310 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-03-09T08:35:43.321 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:43.334 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:43 +0000 (0:00:00.107) 0:01:07.999 ********* 2021-03-09T08:35:43.339 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:43.420 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-03-09T08:35:43.422 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:43.447 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:43 +0000 (0:00:00.112) 0:01:08.111 ********* 2021-03-09T08:35:43.466 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:43.469 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-03-09T08:35:43.534 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:43.562 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:43 +0000 (0:00:00.115) 0:01:08.227 ********* 2021-03-09T08:35:43.625 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:43.627 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-03-09T08:35:43.681 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-03-09T08:35:43.684 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:43.715 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:43 +0000 (0:00:00.152) 0:01:08.379 ********* 2021-03-09T08:35:43.798 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:43.800 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi091.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-09T08:35:43.810 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-09T08:35:43.837 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:43 +0000 (0:00:00.122) 0:01:08.502 ********* 2021-03-09T08:35:43.933 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-09T08:35:43.935 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:43.959 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:43 +0000 (0:00:00.121) 0:01:08.623 ********* 2021-03-09T08:35:43.977 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:43.979 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-03-09T08:35:44.106 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-03-09T08:35:44.169 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-09T08:35:44.171 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.013144", "end": "2021-03-09 08:35:44.527107", "rc": 0, "start": "2021-03-09 08:35:44.513963", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-03-09T08:35:44.195 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:44 +0000 (0:00:00.236) 0:01:08.860 ********* 2021-03-09T08:35:44.245 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:44.247 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-03-09T08:35:44.279 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:44.307 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:44 +0000 (0:00:00.112) 0:01:08.972 ********* 2021-03-09T08:35:44.392 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:44.394 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:44.419 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:44 +0000 (0:00:00.111) 0:01:09.084 ********* 2021-03-09T08:35:44.511 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-09T08:35:44.513 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-03-09T08:35:44.524 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-03-09T08:35:44.537 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi106.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} TASK [common : Mask sleep units] *********************************************** skipping: [smithi091.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-03-09T08:35:44.561 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:44 +0000 (0:00:00.141) 0:01:09.225 ********* 2021-03-09T08:35:44.641 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-09T08:35:44.643 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:44.665 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:44 +0000 (0:00:00.104) 0:01:09.329 ********* 2021-03-09T08:35:44.682 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:44.684 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-03-09T08:35:44.748 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-03-09T08:35:44.750 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:44.773 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:44 +0000 (0:00:00.108) 0:01:09.438 ********* 2021-03-09T08:35:44.835 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:44.837 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-03-09T08:35:44.858 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:44.859 INFO:teuthology.task.ansible.out:TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:44.883 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:44 +0000 (0:00:00.109) 0:01:09.548 ********* 2021-03-09T08:35:44.965 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:44.967 INFO:teuthology.task.ansible.out:TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi106.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-03-09T08:35:44.996 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:44 +0000 (0:00:00.112) 0:01:09.661 ********* 2021-03-09T08:35:45.067 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-03-09T08:35:45.069 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:45.091 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:45 +0000 (0:00:00.094) 0:01:09.755 ********* 2021-03-09T08:35:45.111 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:45.113 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-03-09T08:35:45.262 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-03-09T08:35:45.402 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-03-09T08:35:45.533 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-03-09T08:35:45.671 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-03-09T08:35:45.831 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-03-09T08:35:45.968 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-03-09T08:35:45.970 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:46.106 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-03-09T08:35:46.150 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-03-09T08:35:46.152 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.918964", "end": "2021-03-09 08:35:46.500449", "rc": 0, "start": "2021-03-09 08:35:45.581485", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:35:46.175 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:46 +0000 (0:00:01.083) 0:01:10.839 ********* 2021-03-09T08:35:46.255 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-03-09T08:35:46.257 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [smithi106.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-03-09T08:35:46.283 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:46 +0000 (0:00:00.107) 0:01:10.947 ********* 2021-03-09T08:35:46.395 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-03-09T08:35:46.522 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-03-09T08:35:46.524 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.025244", "end": "2021-03-09 08:35:46.875605", "rc": 0, "start": "2021-03-09 08:35:46.850361", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:35:46.550 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:46 +0000 (0:00:00.266) 0:01:11.214 ********* 2021-03-09T08:35:46.558 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:46.558 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-03-09T08:35:46.676 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-03-09T08:35:46.814 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-03-09T08:35:46.953 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-03-09T08:35:47.090 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-03-09T08:35:47.238 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-03-09T08:35:47.389 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-03-09T08:35:47.540 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-03-09T08:35:47.671 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-03-09T08:35:47.831 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-03-09T08:35:47.969 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-03-09T08:35:48.102 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-03-09T08:35:48.240 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-03-09T08:35:48.379 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-03-09T08:35:48.517 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-03-09T08:35:48.665 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-03-09T08:35:48.803 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-03-09T08:35:48.940 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-03-09T08:35:49.088 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-03-09T08:35:49.235 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-03-09T08:35:49.374 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-03-09T08:35:49.515 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-03-09T08:35:49.652 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-03-09T08:35:49.705 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-03-09T08:35:49.707 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1615278859, "cache_updated": false, "changed": false} 2021-03-09T08:35:49.730 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:49 +0000 (0:00:03.180) 0:01:14.394 ********* 2021-03-09T08:35:49.790 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-09T08:35:49.791 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-03-09T08:35:49.928 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-03-09T08:35:50.065 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-03-09T08:35:50.203 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-03-09T08:35:50.261 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:50 +0000 (0:00:00.530) 0:01:14.925 ********* 2021-03-09T08:35:50.668 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-03-09T08:35:50.671 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"cache_update_time": 1615278859, "cache_updated": false, "changed": false} 2021-03-09T08:35:50.697 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:50 +0000 (0:00:00.435) 0:01:15.361 ********* 2021-03-09T08:35:50.716 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-03-09T08:35:50.719 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "checksum": "1d9711ff879c231c67cb70d00ca0088797a377d0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "80a55def4b505d08aff3687f81f74dc2", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615278950.352208-15913-136385850075836/source", "state": "file", "uid": 0} 2021-03-09T08:35:50.743 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:50 +0000 (0:00:00.045) 0:01:15.407 ********* 2021-03-09T08:35:50.793 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:50.818 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:50 +0000 (0:00:00.074) 0:01:15.482 ********* 2021-03-09T08:35:50.828 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-03-09T08:35:50.831 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => { "msg": "Host smithi106.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-03-09T08:35:50.854 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:50 +0000 (0:00:00.035) 0:01:15.518 ********* 2021-03-09T08:35:50.952 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-03-09T08:35:50.954 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-03-09T08:35:50.979 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:50 +0000 (0:00:00.125) 0:01:15.644 ********* 2021-03-09T08:35:51.049 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-03-09T08:35:51.051 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:51.072 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:51 +0000 (0:00:00.093) 0:01:15.737 ********* 2021-03-09T08:35:51.144 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-03-09T08:35:51.146 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:51.169 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:51 +0000 (0:00:00.096) 0:01:15.834 ********* 2021-03-09T08:35:51.250 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-03-09T08:35:51.252 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:51.279 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:51 +0000 (0:00:00.109) 0:01:15.943 ********* 2021-03-09T08:35:51.351 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-03-09T08:35:51.353 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:51.378 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:51 +0000 (0:00:00.099) 0:01:16.043 ********* 2021-03-09T08:35:51.459 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-03-09T08:35:51.461 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:51.486 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:51 +0000 (0:00:00.107) 0:01:16.150 ********* 2021-03-09T08:35:51.536 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-03-09T08:35:51.538 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-03-09T08:35:51.563 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:51 +0000 (0:00:00.077) 0:01:16.227 ********* 2021-03-09T08:35:51.572 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-03-09T08:35:51.573 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:51.599 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:51 +0000 (0:00:00.035) 0:01:16.263 ********* 2021-03-09T08:35:51.676 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:51.700 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:51 +0000 (0:00:00.101) 0:01:16.364 ********* 2021-03-09T08:35:51.792 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-03-09T08:35:51.794 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:51.819 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:51 +0000 (0:00:00.118) 0:01:16.483 ********* 2021-03-09T08:35:51.931 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-03-09T08:35:51.934 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-09T08:35:51.961 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:51 +0000 (0:00:00.141) 0:01:16.625 ********* 2021-03-09T08:35:52.043 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:52.069 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:52 +0000 (0:00:00.108) 0:01:16.734 ********* 2021-03-09T08:35:52.153 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-03-09T08:35:52.155 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:52.182 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:52 +0000 (0:00:00.112) 0:01:16.846 ********* 2021-03-09T08:35:52.272 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-03-09T08:35:52.274 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-09T08:35:52.297 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:52 +0000 (0:00:00.115) 0:01:16.962 ********* 2021-03-09T08:35:52.380 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-03-09T08:35:52.382 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:52.404 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:52 +0000 (0:00:00.106) 0:01:17.068 ********* 2021-03-09T08:35:52.478 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-03-09T08:35:52.479 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"cache_update_time": 1615278859, "cache_updated": false, "changed": false} 2021-03-09T08:35:52.503 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:52 +0000 (0:00:00.099) 0:01:17.168 ********* 2021-03-09T08:35:52.510 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-03-09T08:35:52.512 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-09T08:35:52.539 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:52 +0000 (0:00:00.035) 0:01:17.203 ********* 2021-03-09T08:35:52.620 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-03-09T08:35:52.621 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:52.647 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:52 +0000 (0:00:00.107) 0:01:17.311 ********* 2021-03-09T08:35:52.717 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-03-09T08:35:52.719 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:52.741 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:52 +0000 (0:00:00.094) 0:01:17.405 ********* 2021-03-09T08:35:52.834 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-03-09T08:35:52.836 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:52.859 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:52 +0000 (0:00:00.118) 0:01:17.524 ********* 2021-03-09T08:35:52.931 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-09T08:35:52.933 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-03-09T08:35:52.943 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-03-09T08:35:52.945 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:52.967 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:52 +0000 (0:00:00.107) 0:01:17.632 ********* 2021-03-09T08:35:53.049 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-09T08:35:53.073 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:53 +0000 (0:00:00.105) 0:01:17.738 ********* 2021-03-09T08:35:53.143 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-09T08:35:53.145 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:53.167 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:53 +0000 (0:00:00.093) 0:01:17.831 ********* 2021-03-09T08:35:53.240 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:53.301 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:53 +0000 (0:00:00.134) 0:01:17.966 ********* 2021-03-09T08:35:53.335 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi091.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-03-09T08:35:53.432 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:53.463 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:53 +0000 (0:00:00.156) 0:01:18.122 ********* 2021-03-09T08:35:53.604 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:53.630 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:53 +0000 (0:00:00.172) 0:01:18.294 ********* 2021-03-09T08:35:53.763 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-03-09T08:35:53.765 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:53.791 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:53 +0000 (0:00:00.159) 0:01:18.453 ********* 2021-03-09T08:35:53.801 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-09T08:35:53.806 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-03-09T08:35:53.845 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:53 +0000 (0:00:00.056) 0:01:18.510 ********* 2021-03-09T08:35:53.847 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:53.919 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:53.921 INFO:teuthology.task.ansible.out:TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:53.946 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:53 +0000 (0:00:00.100) 0:01:18.611 ********* 2021-03-09T08:35:54.039 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-03-09T08:35:54.041 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-09T08:35:54.063 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:54 +0000 (0:00:00.117) 0:01:18.728 ********* 2021-03-09T08:35:54.071 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-03-09T08:35:54.073 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-03-09T08:35:54.100 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:54 +0000 (0:00:00.036) 0:01:18.765 ********* 2021-03-09T08:35:54.171 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:54.198 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:54 +0000 (0:00:00.097) 0:01:18.862 ********* 2021-03-09T08:35:54.279 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:54.303 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:54 +0000 (0:00:00.105) 0:01:18.967 ********* 2021-03-09T08:35:54.394 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-03-09T08:35:54.395 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:54.428 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:54 +0000 (0:00:00.125) 0:01:19.093 ********* 2021-03-09T08:35:54.559 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-03-09T08:35:54.561 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:54.584 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:54 +0000 (0:00:00.155) 0:01:19.249 ********* 2021-03-09T08:35:54.602 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:54.604 INFO:teuthology.task.ansible.out:TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi091.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-03-09T08:35:54.688 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-03-09T08:35:54.689 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-09T08:35:54.716 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:54 +0000 (0:00:00.131) 0:01:19.380 ********* 2021-03-09T08:35:54.796 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-09T08:35:54.798 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:54.822 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:54 +0000 (0:00:00.105) 0:01:19.486 ********* 2021-03-09T08:35:54.969 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-09T08:35:54.970 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-03-09T08:35:55.044 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-09T08:35:55.046 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.015962", "end": "2021-03-09 08:35:54.533639", "rc": 0, "start": "2021-03-09 08:35:54.517677", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-03-09T08:35:55.071 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:55 +0000 (0:00:00.248) 0:01:19.735 ********* 2021-03-09T08:35:55.152 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-03-09T08:35:55.154 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:55.176 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:55 +0000 (0:00:00.105) 0:01:19.840 ********* 2021-03-09T08:35:55.245 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-03-09T08:35:55.247 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:55.270 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:55 +0000 (0:00:00.094) 0:01:19.935 ********* 2021-03-09T08:35:55.278 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-09T08:35:55.280 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-03-09T08:35:55.308 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:55 +0000 (0:00:00.037) 0:01:19.972 ********* 2021-03-09T08:35:55.367 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:55.370 INFO:teuthology.task.ansible.out:TASK [common : Mask sleep units] *********************************************** skipping: [smithi106.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-03-09T08:35:55.391 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-03-09T08:35:55.393 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-03-09T08:35:55.415 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:55 +0000 (0:00:00.107) 0:01:20.080 ********* 2021-03-09T08:35:55.425 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-03-09T08:35:55.427 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-03-09T08:35:55.454 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:55 +0000 (0:00:00.039) 0:01:20.119 ********* 2021-03-09T08:35:55.495 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-09T08:35:55.497 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:55.520 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:55 +0000 (0:00:00.065) 0:01:20.185 ********* 2021-03-09T08:35:55.542 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-03-09T08:35:55.544 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:55.568 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:55 +0000 (0:00:00.047) 0:01:20.232 ********* 2021-03-09T08:35:55.606 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-03-09T08:35:55.608 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:55.632 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:55 +0000 (0:00:00.063) 0:01:20.296 ********* 2021-03-09T08:35:55.651 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-03-09T08:35:55.653 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-09T08:35:55.682 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:55 +0000 (0:00:00.050) 0:01:20.347 ********* 2021-03-09T08:35:55.711 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:55.737 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:55 +0000 (0:00:00.054) 0:01:20.401 ********* 2021-03-09T08:35:55.766 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-03-09T08:35:55.768 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-09T08:35:55.778 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-09T08:35:55.789 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-09T08:35:55.814 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:55 +0000 (0:00:00.077) 0:01:20.478 ********* 2021-03-09T08:35:55.821 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-03-09T08:35:55.823 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:55.847 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:55 +0000 (0:00:00.033) 0:01:20.512 ********* 2021-03-09T08:35:55.896 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-03-09T08:35:55.898 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:55.924 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:55 +0000 (0:00:00.076) 0:01:20.588 ********* 2021-03-09T08:35:55.932 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-03-09T08:35:55.934 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:55.961 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:55 +0000 (0:00:00.036) 0:01:20.625 ********* 2021-03-09T08:35:56.888 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-03-09T08:35:56.890 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"cache_update_time": 1615278859, "cache_updated": false, "changed": false} 2021-03-09T08:35:56.913 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:56 +0000 (0:00:00.952) 0:01:21.578 ********* 2021-03-09T08:35:56.915 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:57.016 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-03-09T08:35:57.018 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.909740", "end": "2021-03-09 08:35:56.500454", "rc": 0, "start": "2021-03-09 08:35:55.590714", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:35:57.041 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:57 +0000 (0:00:00.127) 0:01:21.705 ********* 2021-03-09T08:35:57.144 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-03-09T08:35:57.146 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:57.171 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:57 +0000 (0:00:00.130) 0:01:21.836 ********* 2021-03-09T08:35:57.172 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:57.297 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-03-09T08:35:57.299 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-03-09T08:35:57.327 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:57 +0000 (0:00:00.155) 0:01:21.991 ********* 2021-03-09T08:35:57.430 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.024229", "end": "2021-03-09 08:35:56.923271", "rc": 0, "start": "2021-03-09 08:35:56.899042", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:35:57.458 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:57 +0000 (0:00:00.130) 0:01:22.122 ********* 2021-03-09T08:35:57.768 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-03-09T08:35:57.770 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-03-09T08:35:57.795 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:57 +0000 (0:00:00.336) 0:01:22.459 ********* 2021-03-09T08:35:58.012 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-09T08:35:58.014 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-03-09T08:35:58.131 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-03-09T08:35:58.156 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:58 +0000 (0:00:00.362) 0:01:22.821 ********* 2021-03-09T08:35:58.238 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-03-09T08:35:58.240 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:58.264 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:58 +0000 (0:00:00.107) 0:01:22.928 ********* 2021-03-09T08:35:58.502 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:58.503 INFO:teuthology.task.ansible.out:TASK [common : Check firewalld status] ***************************************** skipping: [smithi091.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-09T08:35:58.529 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:58 +0000 (0:00:00.264) 0:01:23.193 ********* 2021-03-09T08:35:58.726 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-03-09T08:35:58.728 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:35:58.751 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:58 +0000 (0:00:00.222) 0:01:23.416 ********* 2021-03-09T08:35:59.297 INFO:teuthology.task.ansible.out: 2021-03-09T08:35:59.299 INFO:teuthology.task.ansible.out:TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-03-09T08:35:59.324 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:35:59 +0000 (0:00:00.572) 0:01:23.988 ********* 2021-03-09T08:36:00.100 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-03-09T08:36:00.101 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2021-03-09 08:33:30 UTC", "ActiveEnterTimestampMonotonic": "17015668", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target network.target -.mount nss-lookup.target var-run.mount systemd-tmpfiles-setup.service remote-fs.target basic.target local-fs.target system.slice time-sync.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2021-03-09 08:33:30 UTC", "AssertTimestampMonotonic": "17014903", "Before": "plymouth-quit.service multi-user.target shutdown.target getty@tty1.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2021-03-09 08:33:30 UTC", "ConditionTimestampMonotonic": "17014903", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-03-09T08:36:00.103 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1273", "ExecMainStartTimestamp": "Tue 2021-03-09 08:33:30 UTC", "ExecMainStartTimestampMonotonic": "17015637", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2021-03-09 08:33:30 UTC", "InactiveExitTimestampMonotonic": "17015668", "InvocationID": "ede3bc16629049c28cb9992f3605c42f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "i 2021-03-09T08:36:00.105 INFO:teuthology.task.ansible.out:nfinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128028", "LimitNPROCSoft": "128028", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128028", "LimitSIGPENDINGSoft": "128028", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1273", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no" 2021-03-09T08:36:00.106 INFO:teuthology.task.ansible.out:, "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2021-03-09 08:33:30 UTC", "StateChangeTimestampMonotonic": "17015668", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2021-03-09 08:33:30 UTC", "WatchdogTimestampMonotonic": "17015667", "WatchdogUSec": "0"}} 2021-03-09T08:36:00.126 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:00 +0000 (0:00:00.802) 0:01:24.791 ********* 2021-03-09T08:36:00.196 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:00.220 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:00 +0000 (0:00:00.093) 0:01:24.885 ********* 2021-03-09T08:36:00.296 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-03-09T08:36:00.298 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:00.324 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:00 +0000 (0:00:00.103) 0:01:24.988 ********* 2021-03-09T08:36:00.362 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-03-09T08:36:00.364 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1615278864, "cache_updated": false, "changed": false} 2021-03-09T08:36:00.387 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:00 +0000 (0:00:00.063) 0:01:25.052 ********* 2021-03-09T08:36:00.416 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-03-09T08:36:00.418 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:00.444 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:00 +0000 (0:00:00.056) 0:01:25.108 ********* 2021-03-09T08:36:00.525 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-03-09T08:36:00.526 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:00.550 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:00 +0000 (0:00:00.105) 0:01:25.214 ********* 2021-03-09T08:36:00.631 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:00.660 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:00 +0000 (0:00:00.110) 0:01:25.325 ********* 2021-03-09T08:36:00.746 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-03-09T08:36:00.748 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:00.771 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:00 +0000 (0:00:00.111) 0:01:25.436 ********* 2021-03-09T08:36:00.865 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-03-09T08:36:00.873 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:00.894 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:00 +0000 (0:00:00.122) 0:01:25.558 ********* 2021-03-09T08:36:00.981 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:01.007 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:01 +0000 (0:00:00.113) 0:01:25.671 ********* 2021-03-09T08:36:01.088 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-03-09T08:36:01.090 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:01.112 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:01 +0000 (0:00:00.104) 0:01:25.776 ********* 2021-03-09T08:36:01.192 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-03-09T08:36:01.194 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:01.216 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:01 +0000 (0:00:00.104) 0:01:25.881 ********* 2021-03-09T08:36:01.287 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:01.288 INFO:teuthology.task.ansible.out:TASK [testnode : Include package type specific vars.] ************************** ok: [smithi091.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-03-09T08:36:01.314 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:01 +0000 (0:00:00.097) 0:01:25.978 ********* 2021-03-09T08:36:01.366 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-03-09T08:36:01.368 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1615278864, "cache_updated": false, "changed": false} 2021-03-09T08:36:01.396 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:01 +0000 (0:00:00.081) 0:01:26.060 ********* 2021-03-09T08:36:01.439 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi091.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-03-09T08:36:01.457 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:01 +0000 (0:00:00.060) 0:01:26.120 ********* 2021-03-09T08:36:01.506 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:01.531 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:01 +0000 (0:00:00.075) 0:01:26.196 ********* 2021-03-09T08:36:01.553 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-03-09T08:36:01.555 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-03-09T08:36:01.590 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:01 +0000 (0:00:00.058) 0:01:26.254 ********* 2021-03-09T08:36:01.682 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi091.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-09T08:36:01.705 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:01 +0000 (0:00:00.115) 0:01:26.370 ********* 2021-03-09T08:36:01.862 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-09T08:36:01.891 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:01 +0000 (0:00:00.181) 0:01:26.551 ********* 2021-03-09T08:36:02.116 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-03-09T08:36:02.146 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:02 +0000 (0:00:00.259) 0:01:26.810 ********* 2021-03-09T08:36:02.160 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-03-09T08:36:02.161 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-03-09T08:36:02.197 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:02 +0000 (0:00:00.051) 0:01:26.862 ********* 2021-03-09T08:36:02.240 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-03-09T08:36:02.242 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:02.269 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:02 +0000 (0:00:00.072) 0:01:26.934 ********* 2021-03-09T08:36:02.340 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:02.364 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:02 +0000 (0:00:00.094) 0:01:27.028 ********* 2021-03-09T08:36:02.583 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-03-09T08:36:02.585 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-03-09T08:36:02.608 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:02 +0000 (0:00:00.244) 0:01:27.273 ********* 2021-03-09T08:36:03.099 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-03-09T08:36:03.101 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-03-09T08:36:03.129 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:03 +0000 (0:00:00.520) 0:01:27.793 ********* 2021-03-09T08:36:03.131 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:03.140 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-03-09T08:36:03.142 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1615278864, "cache_updated": false, "changed": false} 2021-03-09T08:36:03.171 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:03 +0000 (0:00:00.042) 0:01:27.836 ********* 2021-03-09T08:36:03.172 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:03.213 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-03-09T08:36:03.214 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi091"}, "changed": false} 2021-03-09T08:36:03.241 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:03 +0000 (0:00:00.069) 0:01:27.905 ********* 2021-03-09T08:36:03.647 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-09T08:36:03.649 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-03-09T08:36:03.966 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-03-09T08:36:04.252 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-03-09T08:36:04.282 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:04 +0000 (0:00:01.040) 0:01:28.946 ********* 2021-03-09T08:36:04.289 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-03-09T08:36:04.292 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi091", "ansible_hostname": "smithi091", "ansible_nodename": "smithi091"}, "changed": false, "name": "smithi091"} 2021-03-09T08:36:04.318 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:04 +0000 (0:00:00.036) 0:01:28.983 ********* 2021-03-09T08:36:04.420 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-03-09T08:36:04.422 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-03-09T08:36:04.446 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:04 +0000 (0:00:00.127) 0:01:29.110 ********* 2021-03-09T08:36:04.727 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-03-09T08:36:04.729 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-03-09T08:36:04.752 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:04 +0000 (0:00:00.306) 0:01:29.417 ********* 2021-03-09T08:36:04.833 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-09T08:36:04.835 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-03-09T08:36:05.145 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-03-09T08:36:05.194 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-03-09T08:36:05.195 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-03-09T08:36:05.223 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:05 +0000 (0:00:00.470) 0:01:29.887 ********* 2021-03-09T08:36:05.474 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-09T08:36:05.477 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-03-09T08:36:05.503 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:05 +0000 (0:00:00.279) 0:01:30.167 ********* 2021-03-09T08:36:05.622 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-03-09T08:36:05.655 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:05 +0000 (0:00:00.152) 0:01:30.319 ********* 2021-03-09T08:36:05.707 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-03-09T08:36:05.711 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-03-09T08:36:05.740 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:05 +0000 (0:00:00.085) 0:01:30.404 ********* 2021-03-09T08:36:05.761 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-03-09T08:36:05.764 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:05.801 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:05 +0000 (0:00:00.061) 0:01:30.465 ********* 2021-03-09T08:36:05.844 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:05.881 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:05 +0000 (0:00:00.079) 0:01:30.545 ********* 2021-03-09T08:36:05.913 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-03-09T08:36:05.915 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-09T08:36:05.949 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:05 +0000 (0:00:00.068) 0:01:30.614 ********* 2021-03-09T08:36:05.958 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-09T08:36:05.960 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:05.993 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:05 +0000 (0:00:00.043) 0:01:30.658 ********* 2021-03-09T08:36:05.994 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:06.082 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-03-09T08:36:06.085 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:06.089 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-09T08:36:06.090 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:06.091 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi106.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:06.121 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:06 +0000 (0:00:00.127) 0:01:30.785 ********* 2021-03-09T08:36:06.130 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:06.133 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:06.159 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:06 +0000 (0:00:00.037) 0:01:30.823 ********* 2021-03-09T08:36:06.228 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-09T08:36:06.230 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:06.269 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:06 +0000 (0:00:00.109) 0:01:30.933 ********* 2021-03-09T08:36:06.276 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-03-09T08:36:06.278 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:06.318 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:06 +0000 (0:00:00.048) 0:01:30.982 ********* 2021-03-09T08:36:06.391 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-09T08:36:06.393 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:06.427 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:06 +0000 (0:00:00.108) 0:01:31.091 ********* 2021-03-09T08:36:06.547 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:06.549 INFO:teuthology.task.ansible.out:TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:06.574 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:06 +0000 (0:00:00.147) 0:01:31.239 ********* 2021-03-09T08:36:06.677 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-09T08:36:06.680 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:06.703 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:06 +0000 (0:00:00.128) 0:01:31.367 ********* 2021-03-09T08:36:06.795 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:06.819 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:06 +0000 (0:00:00.116) 0:01:31.484 ********* 2021-03-09T08:36:06.901 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-03-09T08:36:06.926 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:06 +0000 (0:00:00.107) 0:01:31.591 ********* 2021-03-09T08:36:07.010 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-03-09T08:36:07.039 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:07 +0000 (0:00:00.112) 0:01:31.703 ********* 2021-03-09T08:36:07.119 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-03-09T08:36:07.143 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:07 +0000 (0:00:00.105) 0:01:31.808 ********* 2021-03-09T08:36:07.215 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-03-09T08:36:07.217 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:07.241 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:07 +0000 (0:00:00.097) 0:01:31.906 ********* 2021-03-09T08:36:07.325 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi091.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:07.326 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:07.350 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:07 +0000 (0:00:00.108) 0:01:32.015 ********* 2021-03-09T08:36:07.378 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-03-09T08:36:07.380 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1615278864, "cache_updated": false, "changed": false} 2021-03-09T08:36:07.404 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:07 +0000 (0:00:00.054) 0:01:32.069 ********* 2021-03-09T08:36:07.422 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:07.424 INFO:teuthology.task.ansible.out:TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:07.451 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:07 +0000 (0:00:00.046) 0:01:32.115 ********* 2021-03-09T08:36:07.534 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-09T08:36:07.536 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:07.560 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:07 +0000 (0:00:00.109) 0:01:32.225 ********* 2021-03-09T08:36:07.651 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-03-09T08:36:07.653 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:07.676 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:07 +0000 (0:00:00.115) 0:01:32.341 ********* 2021-03-09T08:36:07.749 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-03-09T08:36:07.751 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:07.776 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:07 +0000 (0:00:00.099) 0:01:32.440 ********* 2021-03-09T08:36:07.793 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-03-09T08:36:07.795 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-03-09T08:36:07.819 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:07 +0000 (0:00:00.043) 0:01:32.484 ********* 2021-03-09T08:36:07.864 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-03-09T08:36:07.865 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:07.888 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:07 +0000 (0:00:00.069) 0:01:32.553 ********* 2021-03-09T08:36:07.980 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-03-09T08:36:07.982 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:08.004 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:08 +0000 (0:00:00.115) 0:01:32.669 ********* 2021-03-09T08:36:08.085 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-09T08:36:08.087 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:08.114 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:08 +0000 (0:00:00.109) 0:01:32.779 ********* 2021-03-09T08:36:08.185 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-09T08:36:08.187 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:08.217 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:08 +0000 (0:00:00.102) 0:01:32.881 ********* 2021-03-09T08:36:08.235 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-03-09T08:36:08.237 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-03-09T08:36:08.270 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:08 +0000 (0:00:00.053) 0:01:32.934 ********* 2021-03-09T08:36:08.301 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-09T08:36:08.303 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:08.326 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:08 +0000 (0:00:00.056) 0:01:32.991 ********* 2021-03-09T08:36:08.417 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:08.441 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:08 +0000 (0:00:00.115) 0:01:33.106 ********* 2021-03-09T08:36:08.470 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-09T08:36:08.472 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-03-09T08:36:08.536 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:08.561 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:08 +0000 (0:00:00.119) 0:01:33.225 ********* 2021-03-09T08:36:08.579 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-09T08:36:08.581 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-03-09T08:36:08.611 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:08 +0000 (0:00:00.050) 0:01:33.275 ********* 2021-03-09T08:36:08.639 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-09T08:36:08.641 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:08.667 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:08 +0000 (0:00:00.055) 0:01:33.331 ********* 2021-03-09T08:36:08.695 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:08.722 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:08 +0000 (0:00:00.054) 0:01:33.386 ********* 2021-03-09T08:36:08.750 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-03-09T08:36:08.751 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:08.784 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:08 +0000 (0:00:00.062) 0:01:33.448 ********* 2021-03-09T08:36:08.803 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-09T08:36:08.830 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:08 +0000 (0:00:00.046) 0:01:33.495 ********* 2021-03-09T08:36:08.870 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-03-09T08:36:08.872 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:08.898 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:08 +0000 (0:00:00.067) 0:01:33.562 ********* 2021-03-09T08:36:08.917 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-03-09T08:36:08.919 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:08.947 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:08 +0000 (0:00:00.049) 0:01:33.612 ********* 2021-03-09T08:36:08.976 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-03-09T08:36:08.979 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:09.003 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:09 +0000 (0:00:00.056) 0:01:33.668 ********* 2021-03-09T08:36:09.087 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:09.089 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:09.114 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:09 +0000 (0:00:00.110) 0:01:33.778 ********* 2021-03-09T08:36:09.184 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-03-09T08:36:09.186 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:09.208 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:09 +0000 (0:00:00.094) 0:01:33.873 ********* 2021-03-09T08:36:09.289 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:09.291 INFO:teuthology.task.ansible.out:TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:09.319 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:09 +0000 (0:00:00.110) 0:01:33.984 ********* 2021-03-09T08:36:09.349 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-03-09T08:36:09.351 INFO:teuthology.task.ansible.out: ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-03-09T08:36:09.377 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:09 +0000 (0:00:00.057) 0:01:34.041 ********* 2021-03-09T08:36:09.396 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-03-09T08:36:09.397 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:09.424 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:09 +0000 (0:00:00.046) 0:01:34.088 ********* 2021-03-09T08:36:09.505 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-03-09T08:36:09.507 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:09.531 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:09 +0000 (0:00:00.107) 0:01:34.196 ********* 2021-03-09T08:36:09.640 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-03-09T08:36:09.643 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2021-03-09 08:33:23 UTC", "ActiveEnterTimestampMonotonic": "17221923", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target systemd-tmpfiles-setup.service basic.target network.target nss-lookup.target -.mount local-fs.target system.slice remote-fs.target var-run.mount systemd-journald.socket sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2021-03-09 08:33:23 UTC", "AssertTimestampMonotonic": "17221190", "Before": "xdm.service shutdown.target plymouth-quit.service getty@tty1.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2021-03-09 08:33:23 UTC", "ConditionTimestampMonotonic": "17221190", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-03-09T08:36:09.644 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1222", "ExecMainStartTimestamp": "Tue 2021-03-09 08:33:23 UTC", "ExecMainStartTimestampMonotonic": "17221881", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2021-03-09 08:33:23 UTC", "InactiveExitTimestampMonotonic": "17221923", "InvocationID": "b291e8b3320345b3993031a7148d5350", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "i 2021-03-09T08:36:09.646 INFO:teuthology.task.ansible.out:nfinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1222", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no" 2021-03-09T08:36:09.648 INFO:teuthology.task.ansible.out:, "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2021-03-09 08:33:23 UTC", "StateChangeTimestampMonotonic": "17221923", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2021-03-09 08:33:23 UTC", "WatchdogTimestampMonotonic": "17221922", "WatchdogUSec": "0"}} 2021-03-09T08:36:09.670 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:09 +0000 (0:00:00.138) 0:01:34.334 ********* 2021-03-09T08:36:09.724 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-03-09T08:36:09.726 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005196", "end": "2021-03-09 08:36:10.084272", "rc": 0, "start": "2021-03-09 08:36:10.079076", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:36:09.759 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:09 +0000 (0:00:00.089) 0:01:34.424 ********* 2021-03-09T08:36:09.773 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-03-09T08:36:09.775 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:09.815 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:09 +0000 (0:00:00.055) 0:01:34.479 ********* 2021-03-09T08:36:09.844 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-03-09T08:36:09.874 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:09 +0000 (0:00:00.059) 0:01:34.539 ********* 2021-03-09T08:36:09.893 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-03-09T08:36:09.895 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:09.919 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:09 +0000 (0:00:00.045) 0:01:34.584 ********* 2021-03-09T08:36:09.993 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-03-09T08:36:09.995 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:10.019 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:10 +0000 (0:00:00.099) 0:01:34.684 ********* 2021-03-09T08:36:10.101 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:10.125 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:10 +0000 (0:00:00.106) 0:01:34.790 ********* 2021-03-09T08:36:10.199 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-03-09T08:36:10.201 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:10.224 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:10 +0000 (0:00:00.098) 0:01:34.888 ********* 2021-03-09T08:36:10.306 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-03-09T08:36:10.309 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:10.331 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:10 +0000 (0:00:00.107) 0:01:34.996 ********* 2021-03-09T08:36:10.339 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-03-09T08:36:10.342 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-03-09T08:36:10.369 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:10 +0000 (0:00:00.036) 0:01:35.033 ********* 2021-03-09T08:36:10.408 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-03-09T08:36:10.409 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:10.434 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:10 +0000 (0:00:00.066) 0:01:35.099 ********* 2021-03-09T08:36:10.452 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-03-09T08:36:10.454 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:10.480 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:10 +0000 (0:00:00.046) 0:01:35.145 ********* 2021-03-09T08:36:10.521 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-03-09T08:36:10.523 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:10.555 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:10 +0000 (0:00:00.074) 0:01:35.220 ********* 2021-03-09T08:36:10.648 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:10.673 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:10 +0000 (0:00:00.118) 0:01:35.338 ********* 2021-03-09T08:36:10.746 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-03-09T08:36:10.747 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:10.772 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:10 +0000 (0:00:00.098) 0:01:35.436 ********* 2021-03-09T08:36:10.854 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-03-09T08:36:10.856 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-03-09T08:36:10.884 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:10 +0000 (0:00:00.111) 0:01:35.548 ********* 2021-03-09T08:36:10.985 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:10.988 INFO:teuthology.task.ansible.out:TASK [testnode : Including distro specific variables.] ************************* ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-03-09T08:36:11.012 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:11 +0000 (0:00:00.128) 0:01:35.677 ********* 2021-03-09T08:36:11.116 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-03-09T08:36:11.118 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-03-09T08:36:11.141 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:11 +0000 (0:00:00.129) 0:01:35.806 ********* 2021-03-09T08:36:11.233 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-03-09T08:36:11.234 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-09T08:36:11.257 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:11 +0000 (0:00:00.115) 0:01:35.921 ********* 2021-03-09T08:36:11.404 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-03-09T08:36:11.405 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-09T08:36:11.428 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:11 +0000 (0:00:00.171) 0:01:36.093 ********* 2021-03-09T08:36:11.613 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-03-09T08:36:11.615 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-03-09T08:36:11.638 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:11 +0000 (0:00:00.209) 0:01:36.302 ********* 2021-03-09T08:36:11.720 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-03-09T08:36:11.722 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:11.745 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:11 +0000 (0:00:00.106) 0:01:36.409 ********* 2021-03-09T08:36:11.825 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-03-09T08:36:11.827 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:11.850 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:11 +0000 (0:00:00.105) 0:01:36.515 ********* 2021-03-09T08:36:11.867 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-03-09T08:36:11.869 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-03-09T08:36:12.072 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-03-09T08:36:12.073 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-03-09T08:36:12.096 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:12 +0000 (0:00:00.245) 0:01:36.760 ********* 2021-03-09T08:36:12.567 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-03-09T08:36:12.569 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-03-09T08:36:12.591 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:12 +0000 (0:00:00.495) 0:01:37.255 ********* 2021-03-09T08:36:12.681 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-03-09T08:36:12.683 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi106"}, "changed": false} 2021-03-09T08:36:12.710 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:12 +0000 (0:00:00.119) 0:01:37.375 ********* 2021-03-09T08:36:12.783 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-03-09T08:36:12.785 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-03-09T08:36:12.810 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:12 +0000 (0:00:00.099) 0:01:37.475 ********* 2021-03-09T08:36:13.302 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-03-09T08:36:13.304 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi106", "ansible_hostname": "smithi106", "ansible_nodename": "smithi106"}, "changed": false, "name": "smithi106"} 2021-03-09T08:36:13.339 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:13 +0000 (0:00:00.528) 0:01:38.004 ********* 2021-03-09T08:36:13.769 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-03-09T08:36:13.771 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"cache_update_time": 1615278859, "cache_updated": false, "changed": false} 2021-03-09T08:36:13.794 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:13 +0000 (0:00:00.454) 0:01:38.458 ********* 2021-03-09T08:36:13.802 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-03-09T08:36:13.804 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-03-09T08:36:13.829 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:13 +0000 (0:00:00.035) 0:01:38.494 ********* 2021-03-09T08:36:13.868 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-03-09T08:36:13.903 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:13 +0000 (0:00:00.073) 0:01:38.568 ********* 2021-03-09T08:36:14.134 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-03-09T08:36:14.136 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.036597", "end": "2021-03-09 08:36:14.487342", "rc": 0, "start": "2021-03-09 08:36:14.450745", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:36:14.160 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:14 +0000 (0:00:00.256) 0:01:38.824 ********* 2021-03-09T08:36:14.232 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-03-09T08:36:14.233 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-03-09T08:36:14.257 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:14 +0000 (0:00:00.097) 0:01:38.921 ********* 2021-03-09T08:36:14.694 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-03-09T08:36:14.696 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-03-09T08:36:14.718 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:14 +0000 (0:00:00.461) 0:01:39.383 ********* 2021-03-09T08:36:14.808 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-03-09T08:36:14.810 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:14.839 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:14 +0000 (0:00:00.119) 0:01:39.503 ********* 2021-03-09T08:36:14.909 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-09T08:36:14.910 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:14.933 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:14 +0000 (0:00:00.094) 0:01:39.598 ********* 2021-03-09T08:36:15.003 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-09T08:36:15.005 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:15.028 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:15 +0000 (0:00:00.094) 0:01:39.692 ********* 2021-03-09T08:36:15.098 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-09T08:36:15.100 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:15.123 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:15 +0000 (0:00:00.095) 0:01:39.788 ********* 2021-03-09T08:36:15.204 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-09T08:36:15.206 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:15.231 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:15 +0000 (0:00:00.107) 0:01:39.895 ********* 2021-03-09T08:36:15.323 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-09T08:36:15.325 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:15.347 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:15 +0000 (0:00:00.115) 0:01:40.011 ********* 2021-03-09T08:36:15.430 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-09T08:36:15.432 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:15.453 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:15 +0000 (0:00:00.106) 0:01:40.118 ********* 2021-03-09T08:36:15.544 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-03-09T08:36:15.545 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:15.570 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:15 +0000 (0:00:00.116) 0:01:40.235 ********* 2021-03-09T08:36:15.651 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-03-09T08:36:15.676 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:15 +0000 (0:00:00.105) 0:01:40.340 ********* 2021-03-09T08:36:15.767 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-03-09T08:36:15.790 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:15 +0000 (0:00:00.113) 0:01:40.454 ********* 2021-03-09T08:36:15.869 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-03-09T08:36:15.893 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:15 +0000 (0:00:00.102) 0:01:40.557 ********* 2021-03-09T08:36:15.973 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-03-09T08:36:15.974 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:15.997 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:15 +0000 (0:00:00.103) 0:01:40.661 ********* 2021-03-09T08:36:16.080 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-03-09T08:36:16.082 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:16.127 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:16 +0000 (0:00:00.130) 0:01:40.792 ********* 2021-03-09T08:36:16.213 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-03-09T08:36:16.215 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:16.237 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:16 +0000 (0:00:00.109) 0:01:40.901 ********* 2021-03-09T08:36:16.320 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-09T08:36:16.321 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:16.370 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:16 +0000 (0:00:00.133) 0:01:41.035 ********* 2021-03-09T08:36:16.454 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-03-09T08:36:16.456 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:16.486 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:16 +0000 (0:00:00.116) 0:01:41.151 ********* 2021-03-09T08:36:16.591 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-03-09T08:36:16.593 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:16.616 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:16 +0000 (0:00:00.129) 0:01:41.281 ********* 2021-03-09T08:36:16.721 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:16.746 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:16 +0000 (0:00:00.129) 0:01:41.410 ********* 2021-03-09T08:36:16.860 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-03-09T08:36:16.862 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:16.884 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:16 +0000 (0:00:00.137) 0:01:41.548 ********* 2021-03-09T08:36:16.963 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-09T08:36:16.965 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:17.000 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:16 +0000 (0:00:00.115) 0:01:41.664 ********* 2021-03-09T08:36:17.129 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:17.130 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:17.158 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:17 +0000 (0:00:00.158) 0:01:41.822 ********* 2021-03-09T08:36:17.198 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** ok: [smithi091.front.sepia.ceph.com] => {"cache_update_time": 1615278859, "cache_updated": false, "changed": false} 2021-03-09T08:36:17.240 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:17 +0000 (0:00:00.081) 0:01:41.904 ********* 2021-03-09T08:36:17.277 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-09T08:36:17.279 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:17.323 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:17 +0000 (0:00:00.082) 0:01:41.987 ********* 2021-03-09T08:36:17.436 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:17.462 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:17 +0000 (0:00:00.139) 0:01:42.126 ********* 2021-03-09T08:36:17.574 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-09T08:36:17.579 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:17.613 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:17 +0000 (0:00:00.151) 0:01:42.278 ********* 2021-03-09T08:36:17.740 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-09T08:36:17.743 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:17.765 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:17 +0000 (0:00:00.151) 0:01:42.429 ********* 2021-03-09T08:36:17.851 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:17.878 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:17 +0000 (0:00:00.113) 0:01:42.543 ********* 2021-03-09T08:36:17.963 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-03-09T08:36:17.964 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:17.995 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:17 +0000 (0:00:00.116) 0:01:42.660 ********* 2021-03-09T08:36:18.077 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-03-09T08:36:18.078 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:18.128 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:18 +0000 (0:00:00.133) 0:01:42.793 ********* 2021-03-09T08:36:18.254 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-03-09T08:36:18.256 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:18.278 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:18 +0000 (0:00:00.149) 0:01:42.942 ********* 2021-03-09T08:36:18.391 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-03-09T08:36:18.393 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:18.420 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:18 +0000 (0:00:00.141) 0:01:43.084 ********* 2021-03-09T08:36:18.528 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-03-09T08:36:18.530 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:18.554 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:18 +0000 (0:00:00.134) 0:01:43.219 ********* 2021-03-09T08:36:18.635 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-03-09T08:36:18.637 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:18.663 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:18 +0000 (0:00:00.108) 0:01:43.327 ********* 2021-03-09T08:36:18.775 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-03-09T08:36:18.777 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:18.799 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:18 +0000 (0:00:00.135) 0:01:43.463 ********* 2021-03-09T08:36:19.007 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-03-09T08:36:19.009 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005113", "end": "2021-03-09 08:36:18.501383", "rc": 0, "start": "2021-03-09 08:36:18.496270", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:36:19.038 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:19 +0000 (0:00:00.239) 0:01:43.702 ********* 2021-03-09T08:36:19.139 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-03-09T08:36:19.165 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:19 +0000 (0:00:00.127) 0:01:43.830 ********* 2021-03-09T08:36:19.607 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:19.609 INFO:teuthology.task.ansible.out:TASK [testnode : Set apt preferences] ****************************************** ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-03-09T08:36:19.634 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:19 +0000 (0:00:00.469) 0:01:44.299 ********* 2021-03-09T08:36:19.635 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:19.721 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-03-09T08:36:19.723 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:19.748 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:19 +0000 (0:00:00.113) 0:01:44.412 ********* 2021-03-09T08:36:20.871 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-03-09T08:36:20.873 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-03-09T08:36:21.803 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-03-09T08:36:21.827 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:21 +0000 (0:00:02.079) 0:01:46.492 ********* 2021-03-09T08:36:22.805 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-03-09T08:36:22.807 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1615278864, "cache_updated": false, "changed": false} 2021-03-09T08:36:22.830 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:22 +0000 (0:00:01.002) 0:01:47.495 ********* 2021-03-09T08:36:22.911 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-03-09T08:36:22.935 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:22 +0000 (0:00:00.104) 0:01:47.599 ********* 2021-03-09T08:36:23.160 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-03-09T08:36:23.162 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.037342", "end": "2021-03-09 08:36:22.642699", "rc": 0, "start": "2021-03-09 08:36:22.605357", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:36:23.187 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:23 +0000 (0:00:00.252) 0:01:47.852 ********* 2021-03-09T08:36:26.041 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-03-09T08:36:26.043 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1615278864, "cache_updated": false, "changed": false} 2021-03-09T08:36:26.067 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:26 +0000 (0:00:02.879) 0:01:50.732 ********* 2021-03-09T08:36:27.437 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 15 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database .. 2021-03-09T08:36:27.440 INFO:teuthology.task.ansible.out:. 95%\r(Reading database ... 100%\r(Reading database ... 102064 files and directories currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 15 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading 2021-03-09T08:36:27.442 INFO:teuthology.task.ansible.out: database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 102064 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-03-09T08:36:27.462 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:27 +0000 (0:00:01.395) 0:01:52.127 ********* 2021-03-09T08:36:28.446 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-09T08:36:28.448 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"cache_update_time": 1615278859, "cache_updated": false, "changed": false} 2021-03-09T08:36:28.491 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:28 +0000 (0:00:01.028) 0:01:53.155 ********* 2021-03-09T08:36:28.594 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:28.596 INFO:teuthology.task.ansible.out:TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:28.620 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:28 +0000 (0:00:00.129) 0:01:53.285 ********* 2021-03-09T08:36:28.622 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:36.104 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-03-09T08:36:36.106 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 15 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 102064 files and directorie 2021-03-09T08:36:36.108 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 15 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2021-03-09T08:36:36.109 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 102064 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-03-09T08:36:36.132 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:36 +0000 (0:00:07.511) 0:02:00.797 ********* 2021-03-09T08:36:37.081 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1615278864, "cache_updated": false, "changed": false} 2021-03-09T08:36:37.105 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:37 +0000 (0:00:00.972) 0:02:01.769 ********* 2021-03-09T08:36:37.196 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:37.230 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:37 +0000 (0:00:00.124) 0:02:01.894 ********* 2021-03-09T08:36:37.240 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-09T08:36:37.242 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => {"cache_update_time": 1615278859, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 15 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.36 [870 kB]\nFetched 10.4 MB in 1s (9469 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database .. 2021-03-09T08:36:37.243 INFO:teuthology.task.ansible.out:. 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101922 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubunt 2021-03-09T08:36:37.245 INFO:teuthology.task.ansible.out:u1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 15 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.36 [870 kB]", "Fetched 10.4 MB in 1s (9469 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(R 2021-03-09T08:36:37.247 INFO:teuthology.task.ansible.out:eading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101922 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-03-09T08:36:37.272 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:37 +0000 (0:00:00.042) 0:02:01.937 ********* 2021-03-09T08:36:38.250 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-03-09T08:36:38.252 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"cache_update_time": 1615278859, "cache_updated": false, "changed": false} 2021-03-09T08:36:38.274 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:38 +0000 (0:00:01.002) 0:02:02.939 ********* 2021-03-09T08:36:39.189 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** ok: [smithi091.front.sepia.ceph.com] => {"cache_update_time": 1615278859, "cache_updated": false, "changed": false} 2021-03-09T08:36:39.226 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:39 +0000 (0:00:00.951) 0:02:03.890 ********* 2021-03-09T08:36:39.466 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:39.468 INFO:teuthology.task.ansible.out:TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-03-09T08:36:39.498 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:39 +0000 (0:00:00.271) 0:02:04.162 ********* 2021-03-09T08:36:39.589 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-03-09T08:36:39.591 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:39.613 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:39 +0000 (0:00:00.115) 0:02:04.277 ********* 2021-03-09T08:36:39.811 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-03-09T08:36:39.813 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-03-09T08:36:39.836 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:39 +0000 (0:00:00.223) 0:02:04.501 ********* 2021-03-09T08:36:40.277 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-03-09T08:36:40.279 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-03-09T08:36:40.304 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:40 +0000 (0:00:00.467) 0:02:04.968 ********* 2021-03-09T08:36:40.538 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi091.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-03-09T08:36:40.563 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:40 +0000 (0:00:00.259) 0:02:05.228 ********* 2021-03-09T08:36:40.774 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-03-09T08:36:40.776 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-09T08:36:40.804 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:40 +0000 (0:00:00.240) 0:02:05.469 ********* 2021-03-09T08:36:41.215 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-03-09T08:36:41.216 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Tue 2021-03-09 08:33:31 UTC", "ActiveEnterTimestampMonotonic": "17595077", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target systemd-tmpfiles-setup.service system.slice -.mount basic.target network.target remote-fs.target sysinit.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2021-03-09 08:33:30 UTC", "AssertTimestampMonotonic": "17013526", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2021-03-09 08:33:30 UTC", "ConditionTimestampMonotonic": "17013526", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2021-03-09T08:36:41.217 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1352", "ExecMainStartTimestamp": "Tue 2021-03-09 08:33:31 UTC", "ExecMainStartTimestampMonotonic": "17595066", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2021-03-09 08:33:30 UTC", "InactiveExitTimestampMonotonic": "17014204", "InvocationID": "71c4362d79664b38bda6a4a3c0f3a11c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2021-03-09T08:36:41.219 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128028", "LimitNPROCSoft": "128028", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128028", "LimitSIGPENDINGSoft": "128028", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1352", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2021-03-09T08:36:41.221 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2021-03-09 08:33:31 UTC", "StateChangeTimestampMonotonic": "17595077", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2021-03-09 08:33:31 UTC", "WatchdogTimestampMonotonic": "17595076", "WatchdogUSec": "0"}} 2021-03-09T08:36:41.242 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:41 +0000 (0:00:00.438) 0:02:05.907 ********* 2021-03-09T08:36:41.327 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-09T08:36:41.328 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:41.366 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:41 +0000 (0:00:00.123) 0:02:06.031 ********* 2021-03-09T08:36:41.505 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-09T08:36:41.507 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:41.532 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:41 +0000 (0:00:00.165) 0:02:06.197 ********* 2021-03-09T08:36:41.654 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:41.688 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:41 +0000 (0:00:00.156) 0:02:06.353 ********* 2021-03-09T08:36:41.692 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:41.803 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:41.804 INFO:teuthology.task.ansible.out:TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-09T08:36:41.805 INFO:teuthology.task.ansible.out: skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:41.828 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:41 +0000 (0:00:00.139) 0:02:06.493 ********* 2021-03-09T08:36:41.830 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:41.945 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:41.969 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:41 +0000 (0:00:00.140) 0:02:06.634 ********* 2021-03-09T08:36:42.064 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:42.090 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:42 +0000 (0:00:00.121) 0:02:06.755 ********* 2021-03-09T08:36:42.182 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-09T08:36:42.184 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:42.209 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:42 +0000 (0:00:00.118) 0:02:06.873 ********* 2021-03-09T08:36:42.290 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-09T08:36:42.292 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:42.315 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:42 +0000 (0:00:00.106) 0:02:06.980 ********* 2021-03-09T08:36:42.397 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:42.399 INFO:teuthology.task.ansible.out:TASK [testnode : set_fact] ***************************************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:42.423 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:42 +0000 (0:00:00.107) 0:02:07.088 ********* 2021-03-09T08:36:42.497 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:42.520 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:42 +0000 (0:00:00.097) 0:02:07.185 ********* 2021-03-09T08:36:42.602 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-09T08:36:42.603 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:42.627 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:42 +0000 (0:00:00.105) 0:02:07.291 ********* 2021-03-09T08:36:42.708 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-09T08:36:42.711 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:42.732 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:42 +0000 (0:00:00.105) 0:02:07.397 ********* 2021-03-09T08:36:42.813 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:42.837 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:42 +0000 (0:00:00.105) 0:02:07.502 ********* 2021-03-09T08:36:42.839 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:42.950 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-09T08:36:42.952 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:42.976 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:42 +0000 (0:00:00.138) 0:02:07.641 ********* 2021-03-09T08:36:43.070 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:43.093 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:43 +0000 (0:00:00.116) 0:02:07.757 ********* 2021-03-09T08:36:43.176 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:43.201 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:43 +0000 (0:00:00.108) 0:02:07.866 ********* 2021-03-09T08:36:43.204 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:43.305 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:43.307 INFO:teuthology.task.ansible.out:TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:43.331 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:43 +0000 (0:00:00.129) 0:02:07.995 ********* 2021-03-09T08:36:43.421 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-09T08:36:43.423 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:43.452 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:43 +0000 (0:00:00.121) 0:02:08.116 ********* 2021-03-09T08:36:43.565 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-09T08:36:43.567 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:43.590 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:43 +0000 (0:00:00.138) 0:02:08.255 ********* 2021-03-09T08:36:43.703 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-09T08:36:43.705 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:43.730 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:43 +0000 (0:00:00.139) 0:02:08.395 ********* 2021-03-09T08:36:43.822 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-09T08:36:43.823 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:43.849 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:43 +0000 (0:00:00.118) 0:02:08.514 ********* 2021-03-09T08:36:43.959 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:43.981 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:43 +0000 (0:00:00.132) 0:02:08.646 ********* 2021-03-09T08:36:44.090 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:44.112 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:44 +0000 (0:00:00.130) 0:02:08.777 ********* 2021-03-09T08:36:44.211 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-09T08:36:44.213 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:44.236 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:44 +0000 (0:00:00.124) 0:02:08.901 ********* 2021-03-09T08:36:44.321 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-09T08:36:44.323 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:44.347 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:44 +0000 (0:00:00.110) 0:02:09.012 ********* 2021-03-09T08:36:44.440 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:44.467 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:44 +0000 (0:00:00.119) 0:02:09.132 ********* 2021-03-09T08:36:44.675 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-03-09T08:36:44.677 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-03-09T08:36:44.699 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:44 +0000 (0:00:00.232) 0:02:09.364 ********* 2021-03-09T08:36:45.126 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-09T08:36:45.128 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-03-09T08:36:45.154 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:45 +0000 (0:00:00.454) 0:02:09.818 ********* 2021-03-09T08:36:45.156 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:45.237 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-09T08:36:45.239 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:45.267 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:45 +0000 (0:00:00.113) 0:02:09.932 ********* 2021-03-09T08:36:45.701 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-03-09T08:36:45.703 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-03-09T08:36:45.732 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:45 +0000 (0:00:00.464) 0:02:10.396 ********* 2021-03-09T08:36:45.879 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-09T08:36:45.881 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1615278864, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 15 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.36 [870 kB]\nFetched 10.4 MB in 1s (9203 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database .. 2021-03-09T08:36:45.883 INFO:teuthology.task.ansible.out:. 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101922 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubunt 2021-03-09T08:36:45.885 INFO:teuthology.task.ansible.out:u1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 15 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.36 [870 kB]", "Fetched 10.4 MB in 1s (9203 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(R 2021-03-09T08:36:45.886 INFO:teuthology.task.ansible.out:eading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101922 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-03-09T08:36:45.928 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:45 +0000 (0:00:00.190) 0:02:10.587 ********* 2021-03-09T08:36:46.230 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-03-09T08:36:46.233 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-03-09T08:36:46.255 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:46 +0000 (0:00:00.332) 0:02:10.919 ********* 2021-03-09T08:36:46.713 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-03-09T08:36:46.715 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-03-09T08:36:46.747 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:46 +0000 (0:00:00.492) 0:02:11.412 ********* 2021-03-09T08:36:46.918 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:46.920 INFO:teuthology.task.ansible.out:TASK [testnode : Install non aarch64 packages] ********************************* 2021-03-09T08:36:46.920 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1615278864, "cache_updated": false, "changed": false} 2021-03-09T08:36:46.947 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:46 +0000 (0:00:00.199) 0:02:11.612 ********* 2021-03-09T08:36:46.965 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-03-09T08:36:46.967 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-09T08:36:46.994 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:46 +0000 (0:00:00.046) 0:02:11.658 ********* 2021-03-09T08:36:47.087 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-03-09T08:36:47.089 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.111 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:47 +0000 (0:00:00.117) 0:02:11.776 ********* 2021-03-09T08:36:47.192 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.216 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:47 +0000 (0:00:00.104) 0:02:11.880 ********* 2021-03-09T08:36:47.299 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-03-09T08:36:47.301 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.327 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:47 +0000 (0:00:00.110) 0:02:11.991 ********* 2021-03-09T08:36:47.396 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:47.398 INFO:teuthology.task.ansible.out:TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.422 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:47 +0000 (0:00:00.094) 0:02:12.086 ********* 2021-03-09T08:36:47.492 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-03-09T08:36:47.494 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.516 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:47 +0000 (0:00:00.094) 0:02:12.181 ********* 2021-03-09T08:36:47.587 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-09T08:36:47.589 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-03-09T08:36:47.614 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:47 +0000 (0:00:00.097) 0:02:12.278 ********* 2021-03-09T08:36:47.716 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-03-09T08:36:47.718 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.739 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.750 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.752 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.761 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.773 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-03-09T08:36:47.784 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.786 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.795 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.798 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.807 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.808 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.818 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.820 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:47.850 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:47 +0000 (0:00:00.236) 0:02:12.515 ********* 2021-03-09T08:36:47.859 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-03-09T08:36:47.861 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1615278864, "cache_updated": false, "changed": false} 2021-03-09T08:36:47.897 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:47 +0000 (0:00:00.046) 0:02:12.561 ********* 2021-03-09T08:36:48.074 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-03-09T08:36:48.076 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-03-09T08:36:48.098 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:48 +0000 (0:00:00.201) 0:02:12.763 ********* 2021-03-09T08:36:48.126 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-03-09T08:36:48.128 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.006765", "end": "2021-03-09 08:36:48.101499", "rc": 0, "start": "2021-03-09 08:36:48.094734", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/bin/teuthology-lock"]} 2021-03-09T08:36:48.158 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:48 +0000 (0:00:00.059) 0:02:12.822 ********* 2021-03-09T08:36:48.176 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-03-09T08:36:48.178 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:48.201 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:48 +0000 (0:00:00.043) 0:02:12.866 ********* 2021-03-09T08:36:48.241 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:48.267 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:48 +0000 (0:00:00.065) 0:02:12.932 ********* 2021-03-09T08:36:48.359 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-03-09T08:36:48.361 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:48.384 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:48 +0000 (0:00:00.116) 0:02:13.048 ********* 2021-03-09T08:36:48.401 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-03-09T08:36:48.403 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-03-09T08:36:48.432 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:48 +0000 (0:00:00.048) 0:02:13.097 ********* 2021-03-09T08:36:48.464 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-03-09T08:36:48.465 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:48.491 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:48 +0000 (0:00:00.058) 0:02:13.155 ********* 2021-03-09T08:36:48.889 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-03-09T08:36:48.890 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-03-09T08:36:48.914 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:48 +0000 (0:00:00.423) 0:02:13.579 ********* 2021-03-09T08:36:49.147 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-03-09T08:36:49.148 INFO:teuthology.task.ansible.out: ok: [smithi106.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-03-09T08:36:49.177 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:49 +0000 (0:00:00.261) 0:02:13.840 ********* 2021-03-09T08:36:49.419 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-03-09T08:36:49.420 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-09T08:36:49.443 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:49 +0000 (0:00:00.267) 0:02:14.108 ********* 2021-03-09T08:36:49.471 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-03-09T08:36:49.473 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"cache_update_time": 1615278859, "cache_updated": false, "changed": false} 2021-03-09T08:36:49.498 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:49 +0000 (0:00:00.054) 0:02:14.162 ********* 2021-03-09T08:36:49.579 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-03-09T08:36:49.581 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:49.603 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:49 +0000 (0:00:00.105) 0:02:14.268 ********* 2021-03-09T08:36:49.758 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:49.760 INFO:teuthology.task.ansible.out:TASK [testnode : Set root disk] ************************************************ ok: [smithi091.front.sepia.ceph.com] => (item={'block_used': 13643758, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226451350, 'size_available': 927544729600, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113943, 'block_size': 4096, 'inode_available': 60941033}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226451350, "block_size": 4096, "block_total": 240095108, "block_used": 13643758, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941033, "inode_total": 61054976, "inode_used": 113943, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927544729600, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}} 2021-03-09T08:36:49.785 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:49 +0000 (0:00:00.181) 0:02:14.449 ********* 2021-03-09T08:36:49.899 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-03-09T08:36:49.900 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Tue 2021-03-09 08:33:24 UTC", "ActiveEnterTimestampMonotonic": "17659331", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target systemd-journald.socket system.slice nss-lookup.target -.mount systemd-tmpfiles-setup.service basic.target network.target sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2021-03-09 08:33:23 UTC", "AssertTimestampMonotonic": "17222044", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2021-03-09 08:33:23 UTC", "ConditionTimestampMonotonic": "17222044", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2021-03-09T08:36:49.902 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1343", "ExecMainStartTimestamp": "Tue 2021-03-09 08:33:24 UTC", "ExecMainStartTimestampMonotonic": "17659320", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2021-03-09 08:33:23 UTC", "InactiveExitTimestampMonotonic": "17222706", "InvocationID": "acf0ecf3368d4288b5f26959aa01de30", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2021-03-09T08:36:49.903 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1343", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2021-03-09T08:36:49.905 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2021-03-09 08:33:24 UTC", "StateChangeTimestampMonotonic": "17659331", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2021-03-09 08:33:24 UTC", "WatchdogTimestampMonotonic": "17659331", "WatchdogUSec": "0"}} 2021-03-09T08:36:49.927 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:49 +0000 (0:00:00.142) 0:02:14.591 ********* 2021-03-09T08:36:50.018 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:50.020 INFO:teuthology.task.ansible.out:TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.010124", "end": "2021-03-09 08:36:50.375900", "rc": 0, "start": "2021-03-09 08:36:50.365776", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:36:50.047 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:50 +0000 (0:00:00.120) 0:02:14.712 ********* 2021-03-09T08:36:50.056 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-09T08:36:50.057 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:50.084 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:50 +0000 (0:00:00.036) 0:02:14.749 ********* 2021-03-09T08:36:50.165 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-03-09T08:36:50.167 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'block_used': 13643758, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226451350, 'size_available': 927544729600, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113943, 'block_size': 4096, 'inode_available': 60941033}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226451350, "block_size": 4096, "block_total": 240095108, "block_used": 13643758, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941033, "inode_total": 61054976, "inode_used": 113943, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927544729600, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:50.190 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:50 +0000 (0:00:00.106) 0:02:14.855 ********* 2021-03-09T08:36:50.198 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-09T08:36:50.200 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:50.242 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:50 +0000 (0:00:00.051) 0:02:14.907 ********* 2021-03-09T08:36:50.263 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-03-09T08:36:50.292 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:50 +0000 (0:00:00.050) 0:02:14.957 ********* 2021-03-09T08:36:50.333 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-09T08:36:50.334 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:50.360 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:50 +0000 (0:00:00.067) 0:02:15.024 ********* 2021-03-09T08:36:50.400 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-09T08:36:50.402 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:50.444 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:50.467 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:50 +0000 (0:00:00.107) 0:02:15.132 ********* 2021-03-09T08:36:50.550 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-09T08:36:50.552 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:50.575 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:50 +0000 (0:00:00.107) 0:02:15.239 ********* 2021-03-09T08:36:50.666 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-09T08:36:50.667 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:50.690 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:50 +0000 (0:00:00.115) 0:02:15.355 ********* 2021-03-09T08:36:50.778 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-09T08:36:50.780 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:50.802 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:50 +0000 (0:00:00.112) 0:02:15.467 ********* 2021-03-09T08:36:50.884 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-09T08:36:50.886 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:50.907 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:50 +0000 (0:00:00.105) 0:02:15.572 ********* 2021-03-09T08:36:50.999 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:51.024 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:51 +0000 (0:00:00.116) 0:02:15.689 ********* 2021-03-09T08:36:51.106 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-09T08:36:51.108 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:51.136 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:51 +0000 (0:00:00.111) 0:02:15.801 ********* 2021-03-09T08:36:51.138 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:51.217 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-09T08:36:51.219 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:51.244 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:51 +0000 (0:00:00.107) 0:02:15.908 ********* 2021-03-09T08:36:51.334 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-09T08:36:51.337 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:51.360 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:51 +0000 (0:00:00.115) 0:02:16.024 ********* 2021-03-09T08:36:51.430 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-09T08:36:51.431 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:51.455 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:51 +0000 (0:00:00.095) 0:02:16.120 ********* 2021-03-09T08:36:51.570 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-09T08:36:51.572 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:51.597 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:51 +0000 (0:00:00.141) 0:02:16.261 ********* 2021-03-09T08:36:51.700 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:51.726 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:51 +0000 (0:00:00.129) 0:02:16.390 ********* 2021-03-09T08:36:51.807 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-09T08:36:51.809 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:51.839 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:51 +0000 (0:00:00.113) 0:02:16.504 ********* 2021-03-09T08:36:51.930 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-09T08:36:51.932 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:51.954 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:51 +0000 (0:00:00.114) 0:02:16.618 ********* 2021-03-09T08:36:52.036 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-09T08:36:52.038 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:52.066 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:52 +0000 (0:00:00.109) 0:02:16.728 ********* 2021-03-09T08:36:52.144 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-09T08:36:52.146 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:52.168 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:52 +0000 (0:00:00.104) 0:02:16.833 ********* 2021-03-09T08:36:52.272 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-09T08:36:52.274 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:52.306 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:52 +0000 (0:00:00.138) 0:02:16.971 ********* 2021-03-09T08:36:52.399 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-09T08:36:52.401 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:52.426 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:52 +0000 (0:00:00.117) 0:02:17.088 ********* 2021-03-09T08:36:52.519 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-09T08:36:52.521 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41gikjWLbsbF4jrxFt6fGGlBOVNeZSt6Rc'], 'uuids': ['78f4e2f0-2915-4955-a5da-2d5d72ec5cf3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:02.002376", "end": "2021-03-09 08:36:52.868455", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41gikjWLbsbF4jrxFt6fGGlBOVNeZSt6Rc"], "labels": [], "masters": [], "uuids": ["78f4e2f0-2915-4955-a5da-2d5d72ec5cf3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:36:50.866079", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Make fsstress same path as 2021-03-09T08:36:52.523 INFO:teuthology.task.ansible.out:ubuntu.] *************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:52.569 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:52 +0000 (0:00:00.145) 0:02:17.233 ********* 2021-03-09T08:36:52.579 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-09T08:36:52.580 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:52.583 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:52.661 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-09T08:36:52.663 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:52.701 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:52 +0000 (0:00:00.132) 0:02:17.366 ********* 2021-03-09T08:36:52.782 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-09T08:36:52.783 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:52.806 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:52 +0000 (0:00:00.105) 0:02:17.471 ********* 2021-03-09T08:36:52.879 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-09T08:36:52.881 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:52.916 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:52 +0000 (0:00:00.109) 0:02:17.580 ********* 2021-03-09T08:36:53.011 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-03-09T08:36:53.013 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:53.036 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:53 +0000 (0:00:00.119) 0:02:17.700 ********* 2021-03-09T08:36:53.233 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-03-09T08:36:53.234 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-03-09T08:36:53.257 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:53 +0000 (0:00:00.221) 0:02:17.921 ********* 2021-03-09T08:36:53.644 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-09T08:36:53.646 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-03-09T08:36:53.678 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:53 +0000 (0:00:00.421) 0:02:18.342 ********* 2021-03-09T08:36:53.761 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-09T08:36:53.763 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:53.793 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:53 +0000 (0:00:00.115) 0:02:18.458 ********* 2021-03-09T08:36:53.813 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-09T08:36:53.815 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41z6bidh6LtqDTsVPD2bnj9VMmAWvfrYuj'], 'uuids': ['733e07c6-f678-41ab-b180-7cc37ad67e23']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.121227", "end": "2021-03-09 08:36:54.155482", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41z6bidh6LtqDTsVPD2bnj9VMmAWvfrYuj"], "labels": [], "masters": [], "uuids": ["733e07c6-f678-41ab-b180-7cc37ad67e23"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:36:53.034255", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-09T08:36:53.816 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5L78A', 'wwn-0x5000c500918dacd0'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5L78A-part1', 'wwn-0x5000c500918dacd0-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918dacd0', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5L78A', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5L78A", "wwn-0x5000c500918dacd0"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5L78A-part1", "wwn-0x5000c500918dacd0-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5L78A", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918dacd0"}}, "skip_reason": 2021-03-09T08:36:53.818 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-03-09T08:36:54.198 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-03-09T08:36:54.200 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-03-09T08:36:54.222 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:54 +0000 (0:00:00.427) 0:02:18.886 ********* 2021-03-09T08:36:54.639 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-03-09T08:36:54.641 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-03-09T08:36:54.686 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:54 +0000 (0:00:00.464) 0:02:19.351 ********* 2021-03-09T08:36:55.117 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:55.119 INFO:teuthology.task.ansible.out:TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-1EdLT2-pOQE-Edz2-KeoP-qz5K-15Mv-VC1BYK', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300AG400BGN', 'nvme-nvme.8086-43564654363233333030414734303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.165199", "end": "2021-03-09 08:36:55.459673", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-1EdLT2-pOQE-Edz2-KeoP-qz5K-15Mv-VC1BYK", "nvme-INTEL_SSDPEDMD400G4_CVFT623300AG400BGN", "nvme-nvme.8086-43564654363233333030414734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:36:54.294474", "stderr": "", "stderr 2021-03-09T08:36:55.121 INFO:teuthology.task.ansible.out:_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-09T08:36:55.130 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:55.153 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-03-09T08:36:55.155 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-03-09T08:36:55.187 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:55 +0000 (0:00:00.501) 0:02:19.852 ********* 2021-03-09T08:36:55.400 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-03-09T08:36:55.403 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-09T08:36:55.425 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:55 +0000 (0:00:00.237) 0:02:20.089 ********* 2021-03-09T08:36:55.507 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:55.546 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:55 +0000 (0:00:00.114) 0:02:20.210 ********* 2021-03-09T08:36:55.643 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:55.674 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:55 +0000 (0:00:00.127) 0:02:20.338 ********* 2021-03-09T08:36:55.767 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:55.791 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:55 +0000 (0:00:00.117) 0:02:20.456 ********* 2021-03-09T08:36:55.873 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-03-09T08:36:55.874 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:55.900 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:55 +0000 (0:00:00.106) 0:02:20.563 ********* 2021-03-09T08:36:55.980 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:55.983 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:56.007 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:56 +0000 (0:00:00.108) 0:02:20.671 ********* 2021-03-09T08:36:56.108 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-03-09T08:36:56.132 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:56 +0000 (0:00:00.125) 0:02:20.797 ********* 2021-03-09T08:36:56.246 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi106.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:56.257 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:56.258 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:56.280 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:56.282 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:56.303 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-03-09T08:36:56.305 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:56.314 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:56.326 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:56.337 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:56.338 INFO:teuthology.task.ansible.out: skipping: [smithi106.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:56.349 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:56.352 INFO:teuthology.task.ansible.out: skipping: [smithi106.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-03-09T08:36:56.383 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:56 +0000 (0:00:00.250) 0:02:21.047 ********* 2021-03-09T08:36:56.392 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-09T08:36:56.393 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41wZD8czPFEzPWkqsfFDnBx6LpI1KZ9QN0'], 'uuids': ['60f64b53-0159-4de4-a723-2a4c9fff5d8a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.135848", "end": "2021-03-09 08:36:56.739361", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41wZD8czPFEzPWkqsfFDnBx6LpI1KZ9QN0"], "labels": [], "masters": [], "uuids": ["60f64b53-0159-4de4-a723-2a4c9fff5d8a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:36:55.603513", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-09T08:36:56.405 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:56.417 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:56.711 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-03-09T08:36:56.713 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.033374", "end": "2021-03-09 08:36:56.676742", "rc": 0, "start": "2021-03-09 08:36:56.643368", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/bin/teuthology-lock"]} 2021-03-09T08:36:56.753 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:56 +0000 (0:00:00.370) 0:02:21.417 ********* 2021-03-09T08:36:56.859 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-03-09T08:36:56.861 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:56.927 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:56 +0000 (0:00:00.173) 0:02:21.591 ********* 2021-03-09T08:36:57.007 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-03-09T08:36:57.008 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:57.033 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:57 +0000 (0:00:00.106) 0:02:21.698 ********* 2021-03-09T08:36:57.116 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:57.144 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:57 +0000 (0:00:00.109) 0:02:21.808 ********* 2021-03-09T08:36:57.669 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-09T08:36:57.671 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41edSOCFRerj5XctSt8yvoTx2L8y17PYrL'], 'uuids': ['5cac5e2f-1bb1-4ad4-bb28-e22e80049bce']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.121167", "end": "2021-03-09 08:36:58.014892", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41edSOCFRerj5XctSt8yvoTx2L8y17PYrL"], "labels": [], "masters": [], "uuids": ["5cac5e2f-1bb1-4ad4-bb28-e22e80049bce"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:36:56.893725", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-09T08:36:57.681 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:58.089 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1615278864, "cache_updated": false, "changed": false} 2021-03-09T08:36:58.113 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:58 +0000 (0:00:00.969) 0:02:22.778 ********* 2021-03-09T08:36:58.195 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:58.222 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:58 +0000 (0:00:00.109) 0:02:22.887 ********* 2021-03-09T08:36:58.313 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-09T08:36:58.315 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'block_used': 13643759, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226451349, 'size_available': 927544725504, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113943, 'block_size': 4096, 'inode_available': 60941033}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226451349, "block_size": 4096, "block_total": 240095108, "block_used": 13643759, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941033, "inode_total": 61054976, "inode_used": 113943, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927544725504, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}} 2021-03-09T08:36:58.340 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:58 +0000 (0:00:00.117) 0:02:23.004 ********* 2021-03-09T08:36:58.539 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-03-09T08:36:58.541 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009866", "end": "2021-03-09 08:36:58.033833", "rc": 0, "start": "2021-03-09 08:36:58.023967", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:36:58.576 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:58 +0000 (0:00:00.235) 0:02:23.240 ********* 2021-03-09T08:36:58.673 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi106.front.sepia.ceph.com] => (item={'block_used': 13643759, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226451349, 'size_available': 927544725504, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113943, 'block_size': 4096, 'inode_available': 60941033}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226451349, "block_size": 4096, "block_total": 240095108, "block_used": 13643759, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941033, "inode_total": 61054976, "inode_used": 113943, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927544725504, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:58.703 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:58 +0000 (0:00:00.127) 0:02:23.367 ********* 2021-03-09T08:36:58.826 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-03-09T08:36:58.854 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:58 +0000 (0:00:00.150) 0:02:23.519 ********* 2021-03-09T08:36:58.855 INFO:teuthology.task.ansible.out: 2021-03-09T08:36:58.939 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-09T08:36:58.940 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41X8xbJ9aYMZGp26jyM0A1DoX7dv2olVjU'], 'uuids': ['ac1cecbb-4f98-4233-b174-b19b9c3d2c91']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.129498", "end": "2021-03-09 08:36:59.291409", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41X8xbJ9aYMZGp26jyM0A1DoX7dv2olVjU"], "labels": [], "masters": [], "uuids": ["ac1cecbb-4f98-4233-b174-b19b9c3d2c91"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:36:58.161911", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-09T08:36:58.997 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:36:58 +0000 (0:00:00.142) 0:02:23.661 ********* 2021-03-09T08:36:59.007 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:59.265 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-09T08:36:59.267 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:59.551 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41gikjWLbsbF4jrxFt6fGGlBOVNeZSt6Rc'], 'uuids': ['78f4e2f0-2915-4955-a5da-2d5d72ec5cf3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.157013", "end": "2021-03-09 08:36:59.904628", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41gikjWLbsbF4jrxFt6fGGlBOVNeZSt6Rc"], "labels": [], "masters": [], "uuids": ["78f4e2f0-2915-4955-a5da-2d5d72ec5cf3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:36:59.747615", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.152375 s, 757 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.152375 s, 757 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-09T08:36:59.563 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:59.575 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:36:59.853 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41z6bidh6LtqDTsVPD2bnj9VMmAWvfrYuj'], 'uuids': ['733e07c6-f678-41ab-b180-7cc37ad67e23']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.157463", "end": "2021-03-09 08:37:00.204201", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41z6bidh6LtqDTsVPD2bnj9VMmAWvfrYuj"], "labels": [], "masters": [], "uuids": ["733e07c6-f678-41ab-b180-7cc37ad67e23"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:37:00.046738", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15284 s, 755 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15284 s, 755 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-09T08:36:59.855 INFO:teuthology.task.ansible.out: skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5L78A', 'wwn-0x5000c500918dacd0'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5L78A-part1', 'wwn-0x5000c500918dacd0-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918dacd0', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5L78A', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5L78A", "wwn-0x5000c500918dacd0"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5L78A-part1", "wwn-0x5000c500918dacd0-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5L78A", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918dacd0"}}, "skip_reason" 2021-03-09T08:36:59.856 INFO:teuthology.task.ansible.out:: "Conditional result was False"} 2021-03-09T08:37:00.025 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-1EdLT2-pOQE-Edz2-KeoP-qz5K-15Mv-VC1BYK', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300AG400BGN', 'nvme-nvme.8086-43564654363233333030414734303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.045462", "end": "2021-03-09 08:37:00.374416", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-1EdLT2-pOQE-Edz2-KeoP-qz5K-15Mv-VC1BYK", "nvme-INTEL_SSDPEDMD400G4_CVFT623300AG400BGN", "nvme-nvme.8086-43564654363233333030414734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:37:00.328954", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0408639 s, 2.8 GB/s", "std 2021-03-09T08:37:00.027 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0408639 s, 2.8 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:00.041 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:00.042 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:00.338 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41wZD8czPFEzPWkqsfFDnBx6LpI1KZ9QN0'], 'uuids': ['60f64b53-0159-4de4-a723-2a4c9fff5d8a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.157070", "end": "2021-03-09 08:37:00.690558", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41wZD8czPFEzPWkqsfFDnBx6LpI1KZ9QN0"], "labels": [], "masters": [], "uuids": ["60f64b53-0159-4de4-a723-2a4c9fff5d8a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:37:00.533488", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153987 s, 749 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153987 s, 749 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:00.350 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:00.362 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:00.652 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41edSOCFRerj5XctSt8yvoTx2L8y17PYrL'], 'uuids': ['5cac5e2f-1bb1-4ad4-bb28-e22e80049bce']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.161567", "end": "2021-03-09 08:37:00.999469", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41edSOCFRerj5XctSt8yvoTx2L8y17PYrL"], "labels": [], "masters": [], "uuids": ["5cac5e2f-1bb1-4ad4-bb28-e22e80049bce"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:37:00.837902", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156762 s, 736 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156762 s, 736 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:00.653 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:00.667 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:00.963 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41X8xbJ9aYMZGp26jyM0A1DoX7dv2olVjU'], 'uuids': ['ac1cecbb-4f98-4233-b174-b19b9c3d2c91']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.159664", "end": "2021-03-09 08:37:01.309171", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-7F6s6gHezw9S5o7b5SfD1g0rA0ZUYo41X8xbJ9aYMZGp26jyM0A1DoX7dv2olVjU"], "labels": [], "masters": [], "uuids": ["ac1cecbb-4f98-4233-b174-b19b9c3d2c91"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:37:01.149507", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154915 s, 745 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154915 s, 745 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:01.025 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:01 +0000 (0:00:02.028) 0:02:25.689 ********* 2021-03-09T08:37:01.092 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-09T08:37:01.094 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTWlUvUwSa5pcK8iXjfwnofyEakIlmf32q'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.954349", "end": "2021-03-09 08:37:00.540788", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTWlUvUwSa5pcK8iXjfwnofyEakIlmf32q"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:36:58.586439", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-09T08:37:01.105 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:01.116 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:01.471 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi091.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.143879", "end": "2021-03-09 08:37:01.727513", "rc": 0, "start": "2021-03-09 08:37:01.583634", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:01.498 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:01 +0000 (0:00:00.473) 0:02:26.163 ********* 2021-03-09T08:37:01.762 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:01.764 INFO:teuthology.task.ansible.out:TASK [testnode : Check for physical volumes] *********************************** changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.054889", "end": "2021-03-09 08:37:02.113998", "rc": 0, "start": "2021-03-09 08:37:02.059109", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:01.796 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:01 +0000 (0:00:00.297) 0:02:26.461 ********* 2021-03-09T08:37:01.891 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-03-09T08:37:01.978 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:01 +0000 (0:00:00.181) 0:02:26.642 ********* 2021-03-09T08:37:02.041 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-03-09T08:37:02.043 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:02.074 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:02 +0000 (0:00:00.095) 0:02:26.738 ********* 2021-03-09T08:37:02.145 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-03-09T08:37:02.147 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:02.180 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:02 +0000 (0:00:00.106) 0:02:26.844 ********* 2021-03-09T08:37:02.210 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-09T08:37:02.212 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:02.240 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:02 +0000 (0:00:00.060) 0:02:26.905 ********* 2021-03-09T08:37:02.317 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-03-09T08:37:02.318 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:02.351 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:02 +0000 (0:00:00.110) 0:02:27.015 ********* 2021-03-09T08:37:02.416 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-09T08:37:02.417 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTKozYoBJYL9LYQUk7hZWk0xpkSnEAZEpu'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.118606", "end": "2021-03-09 08:37:01.889013", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTKozYoBJYL9LYQUk7hZWk0xpkSnEAZEpu"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:37:00.770407", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-09T08:37:02.421 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHPJ', 'wwn-0x5000c50091e1aea6'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHPJ-part1', 'wwn-0x5000c50091e1aea6-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e1aea6', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QHPJ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHPJ", "wwn-0x5000c50091e1aea6"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHPJ-part1", "wwn-0x5000c50091e1aea6-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QHPJ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e1aea6"}}, "skip_reason": 2021-03-09T08:37:02.423 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-03-09T08:37:02.551 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-03-09T08:37:02.553 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-09T08:37:02.575 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:02 +0000 (0:00:00.224) 0:02:27.240 ********* 2021-03-09T08:37:02.616 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-09T08:37:02.618 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'block_used': 13643758, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226451350, 'size_available': 927544729600, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113943, 'block_size': 4096, 'inode_available': 60941033}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226451350, "block_size": 4096, "block_total": 240095108, "block_used": 13643758, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941033, "inode_total": 61054976, "inode_used": 113943, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927544729600, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:02.652 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:02 +0000 (0:00:00.076) 0:02:27.317 ********* 2021-03-09T08:37:02.691 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-03-09T08:37:02.692 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:02.715 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:02 +0000 (0:00:00.063) 0:02:27.380 ********* 2021-03-09T08:37:02.764 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-09T08:37:02.766 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:02.791 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:02 +0000 (0:00:00.076) 0:02:27.456 ********* 2021-03-09T08:37:02.833 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-09T08:37:02.835 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:02.860 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:02 +0000 (0:00:00.068) 0:02:27.525 ********* 2021-03-09T08:37:02.902 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-03-09T08:37:02.904 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:03.068 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:03 +0000 (0:00:00.207) 0:02:27.732 ********* 2021-03-09T08:37:03.110 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-03-09T08:37:03.112 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:03.136 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:03 +0000 (0:00:00.068) 0:02:27.800 ********* 2021-03-09T08:37:03.169 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:03.193 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:03 +0000 (0:00:00.057) 0:02:27.858 ********* 2021-03-09T08:37:03.676 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-03-09T08:37:03.678 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-03-09T08:37:03.700 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:03 +0000 (0:00:00.507) 0:02:28.365 ********* 2021-03-09T08:37:03.729 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-09T08:37:03.731 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-XHTqe4-u7md-T74m-azJL-ajy0-2mkc-x1NM84', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204013R400BGN', 'nvme-nvme.8086-50484654363230343031335234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.166167", "end": "2021-03-09 08:37:03.203763", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-XHTqe4-u7md-T74m-azJL-ajy0-2mkc-x1NM84", "nvme-INTEL_SSDPEDMD400G4_PHFT6204013R400BGN", "nvme-nvme.8086-50484654363230343031335234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:37:02.037596", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-03-09T08:37:03.733 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-09T08:37:03.743 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:03.744 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:04.184 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-09T08:37:04.416 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-09T08:37:04.681 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-09T08:37:04.936 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-09T08:37:04.937 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:05.012 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-09T08:37:05.014 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTGThvetALYmL0Myk3jkj3Neazqzog3UF9'], 'uuids': ['e1d64c37-42b0-4457-adf7-5ac53b573c90']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.125324", "end": "2021-03-09 08:37:04.489973", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTGThvetALYmL0Myk3jkj3Neazqzog3UF9"], "labels": [], "masters": [], "uuids": ["e1d64c37-42b0-4457-adf7-5ac53b573c90"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:37:03.364649", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi106.front.sepia.ceph.com] => (i 2021-03-09T08:37:05.016 INFO:teuthology.task.ansible.out:tem={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:05.047 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:05.224 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-09T08:37:05.246 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:05 +0000 (0:00:01.545) 0:02:29.911 ********* 2021-03-09T08:37:05.248 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:05.392 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:05.394 INFO:teuthology.task.ansible.out:TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-03-09T08:37:05.419 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:05 +0000 (0:00:00.173) 0:02:30.084 ********* 2021-03-09T08:37:05.614 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-09T08:37:05.616 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-09T08:37:05.757 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-09T08:37:05.895 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-09T08:37:06.024 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-09T08:37:06.036 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:06.062 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:06 +0000 (0:00:00.642) 0:02:30.727 ********* 2021-03-09T08:37:06.114 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-03-09T08:37:06.116 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:06.138 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:06 +0000 (0:00:00.075) 0:02:30.802 ********* 2021-03-09T08:37:06.166 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-03-09T08:37:06.167 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:06.189 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:06 +0000 (0:00:00.051) 0:02:30.854 ********* 2021-03-09T08:37:06.322 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-09T08:37:06.324 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTiCtWyCOHV2AY6CavDKFhD0j8CIRN5zFQ'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.126105", "end": "2021-03-09 08:37:05.798446", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTiCtWyCOHV2AY6CavDKFhD0j8CIRN5zFQ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:37:04.672341", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-09T08:37:06.335 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:06.357 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-03-09T08:37:06.359 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-03-09T08:37:06.382 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:06 +0000 (0:00:00.192) 0:02:31.046 ********* 2021-03-09T08:37:06.437 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi091.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-03-09T08:37:06.463 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:06 +0000 (0:00:00.081) 0:02:31.127 ********* 2021-03-09T08:37:06.856 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-03-09T08:37:06.858 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => {"changed": true} 2021-03-09T08:37:06.883 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:06 +0000 (0:00:00.419) 0:02:31.547 ********* 2021-03-09T08:37:07.249 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-03-09T08:37:07.251 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-03-09T08:37:07.274 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:07 +0000 (0:00:00.391) 0:02:31.938 ********* 2021-03-09T08:37:07.302 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-03-09T08:37:07.304 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:07.328 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:07 +0000 (0:00:00.053) 0:02:31.992 ********* 2021-03-09T08:37:07.356 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-03-09T08:37:07.358 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:07.383 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:07 +0000 (0:00:00.055) 0:02:32.048 ********* 2021-03-09T08:37:07.412 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-09T08:37:07.414 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:07.436 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:07 +0000 (0:00:00.052) 0:02:32.101 ********* 2021-03-09T08:37:07.464 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-09T08:37:07.465 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:07.487 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:07 +0000 (0:00:00.051) 0:02:32.152 ********* 2021-03-09T08:37:07.588 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-09T08:37:07.590 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTbKWsHFF9Wd9oOO4UQ2aWDJEBX38UftYD'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.604758", "end": "2021-03-09 08:37:07.554564", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTbKWsHFF9Wd9oOO4UQ2aWDJEBX38UftYD"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:37:05.949806", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-09T08:37:07.627 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:07 +0000 (0:00:00.139) 0:02:32.292 ********* 2021-03-09T08:37:07.647 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-03-09T08:37:07.673 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:07 +0000 (0:00:00.045) 0:02:32.337 ********* 2021-03-09T08:37:07.680 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-09T08:37:07.682 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:07.819 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-03-09T08:37:07.821 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-03-09T08:37:07.843 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:07 +0000 (0:00:00.170) 0:02:32.508 ********* 2021-03-09T08:37:07.984 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-09T08:37:07.986 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTWlUvUwSa5pcK8iXjfwnofyEakIlmf32q'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.153032", "end": "2021-03-09 08:37:07.943066", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTWlUvUwSa5pcK8iXjfwnofyEakIlmf32q"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:37:07.790034", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.149877 s, 770 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.149877 s, 770 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": 2021-03-09T08:37:07.987 INFO:teuthology.task.ansible.out:{"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:07.997 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:08.221 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-03-09T08:37:08.246 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:08 +0000 (0:00:00.402) 0:02:32.911 ********* 2021-03-09T08:37:08.287 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-09T08:37:08.288 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTKozYoBJYL9LYQUk7hZWk0xpkSnEAZEpu'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.160939", "end": "2021-03-09 08:37:08.258996", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTKozYoBJYL9LYQUk7hZWk0xpkSnEAZEpu"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:37:08.098057", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156114 s, 739 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156114 s, 739 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:08.288 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:08.301 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHPJ', 'wwn-0x5000c50091e1aea6'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHPJ-part1', 'wwn-0x5000c50091e1aea6-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e1aea6', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QHPJ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHPJ", "wwn-0x5000c50091e1aea6"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHPJ-part1", "wwn-0x5000c50091e1aea6-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QHPJ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e1aea6"}}, "skip_reason": 2021-03-09T08:37:08.304 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-03-09T08:37:08.486 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-XHTqe4-u7md-T74m-azJL-ajy0-2mkc-x1NM84', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204013R400BGN', 'nvme-nvme.8086-50484654363230343031335234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.053243", "end": "2021-03-09 08:37:08.459152", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-XHTqe4-u7md-T74m-azJL-ajy0-2mkc-x1NM84", "nvme-INTEL_SSDPEDMD400G4_PHFT6204013R400BGN", "nvme-nvme.8086-50484654363230343031335234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:37:08.405909", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0484935 s, 2.4 GB/s", "std 2021-03-09T08:37:08.488 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0484935 s, 2.4 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:08.498 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:08.509 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:08.510 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:08.630 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-03-09T08:37:08.865 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:08 +0000 (0:00:00.417) 0:02:33.329 ********* TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTGThvetALYmL0Myk3jkj3Neazqzog3UF9'], 'uuids': ['e1d64c37-42b0-4457-adf7-5ac53b573c90']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.156281", "end": "2021-03-09 08:37:08.789032", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTGThvetALYmL0Myk3jkj3Neazqzog3UF9"], "labels": [], "masters": [], "uuids": ["e1d64c37-42b0-4457-adf7-5ac53b573c90"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:37:08.632751", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.152905 s, 754 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.152905 s, 754 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, ' 2021-03-09T08:37:08.867 INFO:teuthology.task.ansible.out:sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:09.173 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTiCtWyCOHV2AY6CavDKFhD0j8CIRN5zFQ'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.160203", "end": "2021-03-09 08:37:09.137326", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTiCtWyCOHV2AY6CavDKFhD0j8CIRN5zFQ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:37:08.977123", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155425 s, 742 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155425 s, 742 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:09.176 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:09.463 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTbKWsHFF9Wd9oOO4UQ2aWDJEBX38UftYD'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.162221", "end": "2021-03-09 08:37:09.435351", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-3cpHytWRl2gg9lXCNcFhIDSkBorLhsUTbKWsHFF9Wd9oOO4UQ2aWDJEBX38UftYD"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-09 08:37:09.273130", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157379 s, 733 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157379 s, 733 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:09.514 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:09 +0000 (0:00:00.849) 0:02:34.178 ********* 2021-03-09T08:37:09.675 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-03-09T08:37:09.677 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"cache_update_time": 1615278859, "cache_updated": false, "changed": false} 2021-03-09T08:37:09.709 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:09 +0000 (0:00:00.195) 0:02:34.374 ********* 2021-03-09T08:37:09.835 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-03-09T08:37:09.836 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.154478", "end": "2021-03-09 08:37:09.804023", "rc": 0, "start": "2021-03-09 08:37:09.649545", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:09.873 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:09 +0000 (0:00:00.163) 0:02:34.538 ********* 2021-03-09T08:37:09.934 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:09.936 INFO:teuthology.task.ansible.out:TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.047950", "end": "2021-03-09 08:37:09.893033", "rc": 0, "start": "2021-03-09 08:37:09.845083", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-03-09T08:37:09.965 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:09 +0000 (0:00:00.091) 0:02:34.629 ********* 2021-03-09T08:37:10.008 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-03-09T08:37:10.010 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:10.034 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:10 +0000 (0:00:00.068) 0:02:34.698 ********* 2021-03-09T08:37:10.046 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:10.098 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-03-09T08:37:10.099 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.049702", "end": "2021-03-09 08:37:10.064055", "rc": 0, "start": "2021-03-09 08:37:10.014353", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:10.138 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:10 +0000 (0:00:00.104) 0:02:34.802 ********* 2021-03-09T08:37:10.161 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-03-09T08:37:10.162 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:10.210 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:10 +0000 (0:00:00.071) 0:02:34.874 ********* 2021-03-09T08:37:10.237 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-03-09T08:37:10.288 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:10 +0000 (0:00:00.077) 0:02:34.952 ********* 2021-03-09T08:37:10.348 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-03-09T08:37:10.350 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:10.378 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:10 +0000 (0:00:00.089) 0:02:35.042 ********* 2021-03-09T08:37:10.474 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-03-09T08:37:10.476 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:10.516 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:10 +0000 (0:00:00.137) 0:02:35.180 ********* 2021-03-09T08:37:10.580 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-09T08:37:10.582 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:10.623 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:10 +0000 (0:00:00.107) 0:02:35.287 ********* 2021-03-09T08:37:10.662 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-03-09T08:37:10.664 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:10.692 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:10 +0000 (0:00:00.069) 0:02:35.357 ********* 2021-03-09T08:37:10.841 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-03-09T08:37:10.843 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-09T08:37:10.868 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:10 +0000 (0:00:00.175) 0:02:35.532 ********* 2021-03-09T08:37:10.873 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:10.971 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-09T08:37:10.973 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'block_used': 13643759, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226451349, 'size_available': 927544725504, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113943, 'block_size': 4096, 'inode_available': 60941033}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226451349, "block_size": 4096, "block_total": 240095108, "block_used": 13643759, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941033, "inode_total": 61054976, "inode_used": 113943, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927544725504, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:11.105 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:11 +0000 (0:00:00.237) 0:02:35.770 ********* 2021-03-09T08:37:11.158 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-03-09T08:37:11.160 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"cache_update_time": 1615278859, "cache_updated": false, "changed": false} 2021-03-09T08:37:11.224 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:11 +0000 (0:00:00.118) 0:02:35.888 ********* 2021-03-09T08:37:11.231 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-03-09T08:37:11.233 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:11.273 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:11 +0000 (0:00:00.049) 0:02:35.937 ********* 2021-03-09T08:37:11.293 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-03-09T08:37:11.296 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:11.324 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:11 +0000 (0:00:00.050) 0:02:35.988 ********* 2021-03-09T08:37:11.356 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-09T08:37:11.358 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:11.390 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:11 +0000 (0:00:00.064) 0:02:36.053 ********* 2021-03-09T08:37:11.459 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-09T08:37:11.462 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:11.496 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:11 +0000 (0:00:00.107) 0:02:36.160 ********* 2021-03-09T08:37:11.534 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-03-09T08:37:11.536 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:11.561 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:11 +0000 (0:00:00.065) 0:02:36.226 ********* 2021-03-09T08:37:11.621 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-03-09T08:37:11.623 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:11.650 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:11 +0000 (0:00:00.084) 0:02:36.311 ********* 2021-03-09T08:37:11.717 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-03-09T08:37:11.719 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:11.754 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:11 +0000 (0:00:00.107) 0:02:36.418 ********* 2021-03-09T08:37:11.819 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-03-09T08:37:11.820 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-03-09T08:37:11.850 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:11 +0000 (0:00:00.096) 0:02:36.514 ********* 2021-03-09T08:37:11.902 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-03-09T08:37:11.904 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:11.942 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:11 +0000 (0:00:00.092) 0:02:36.607 ********* 2021-03-09T08:37:12.144 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-03-09T08:37:12.145 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-03-09T08:37:12.174 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:12 +0000 (0:00:00.231) 0:02:36.839 ********* 2021-03-09T08:37:12.242 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:12.244 INFO:teuthology.task.ansible.out:TASK [testnode : Make sure ntpd is running.] *********************************** 2021-03-09T08:37:12.245 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2021-03-09 08:33:30 UTC", "ActiveEnterTimestampMonotonic": "16392292", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target systemd-journald.socket system.slice systemd-tmpfiles-setup.service sysinit.target basic.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2021-03-09 08:33:29 UTC", "AssertTimestampMonotonic": "16184123", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2021-03-09 08:33:29 UTC", "ConditionTimestampMonotonic": "16184123", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2021-03-09T08:37:12.254 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1221", "ExecMainStartTimestamp": "Tue 2021-03-09 08:33:30 UTC", "ExecMainStartTimestampMonotonic": "16392282", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2021-03-09 08:33:29 UTC", "InactiveExitTimestampMonotonic": "16184914", "InvocationID": "1afd8c8e10ce4c02862308dd1b938b2e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128028", "LimitNPROCSoft": "128028", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2021-03-09T08:37:12.256 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128028", "LimitSIGPENDINGSoft": "128028", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1221", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2021-03-09 08:33:30 UTC", "S 2021-03-09T08:37:12.258 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "16392292", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2021-03-09 08:33:30 UTC", "WatchdogTimestampMonotonic": "16392291", "WatchdogUSec": "0"}} 2021-03-09T08:37:12.274 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:12 +0000 (0:00:00.099) 0:02:36.938 ********* 2021-03-09T08:37:12.338 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-09T08:37:12.339 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-03-09T08:37:12.384 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:12 +0000 (0:00:00.110) 0:02:37.049 ********* 2021-03-09T08:37:12.425 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-09T08:37:12.427 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:12.452 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:12 +0000 (0:00:00.068) 0:02:37.117 ********* 2021-03-09T08:37:12.490 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-03-09T08:37:12.491 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:12.515 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:12 +0000 (0:00:00.062) 0:02:37.179 ********* 2021-03-09T08:37:12.553 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-09T08:37:12.555 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-09T08:37:12.831 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-09T08:37:13.071 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-09T08:37:13.313 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-09T08:37:13.419 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-03-09T08:37:13.421 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"cache_update_time": 1615278859, "cache_updated": false, "changed": false} 2021-03-09T08:37:13.444 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:13 +0000 (0:00:00.929) 0:02:38.109 ********* 2021-03-09T08:37:13.494 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-03-09T08:37:13.496 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:13.519 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:13 +0000 (0:00:00.074) 0:02:38.184 ********* 2021-03-09T08:37:13.615 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-09T08:37:13.616 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-09T08:37:13.645 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:13 +0000 (0:00:00.125) 0:02:38.309 ********* 2021-03-09T08:37:13.795 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-03-09T08:37:13.796 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-03-09T08:37:13.831 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:13 +0000 (0:00:00.183) 0:02:38.494 ********* 2021-03-09T08:37:13.885 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-09T08:37:13.887 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-03-09T08:37:13.912 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:13 +0000 (0:00:00.083) 0:02:38.577 ********* 2021-03-09T08:37:14.123 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-09T08:37:14.125 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-09T08:37:14.302 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-09T08:37:14.507 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-09T08:37:14.552 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-03-09T08:37:14.578 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:14 +0000 (0:00:00.665) 0:02:39.243 ********* 2021-03-09T08:37:14.684 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-09T08:37:14.709 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:14.733 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:14 +0000 (0:00:00.155) 0:02:39.398 ********* 2021-03-09T08:37:14.736 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:14.763 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:14.794 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:14 +0000 (0:00:00.060) 0:02:39.459 ********* 2021-03-09T08:37:14.835 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-03-09T08:37:14.838 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:14.862 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:14 +0000 (0:00:00.066) 0:02:39.526 ********* 2021-03-09T08:37:15.068 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-03-09T08:37:15.070 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-03-09T08:37:15.097 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:15 +0000 (0:00:00.236) 0:02:39.762 ********* 2021-03-09T08:37:15.173 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-03-09T08:37:15.174 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-03-09T08:37:15.199 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:15 +0000 (0:00:00.101) 0:02:39.863 ********* 2021-03-09T08:37:15.504 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-03-09T08:37:15.506 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true} 2021-03-09T08:37:15.527 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:15 +0000 (0:00:00.328) 0:02:40.191 ********* 2021-03-09T08:37:15.700 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-03-09T08:37:15.702 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-03-09T08:37:15.736 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:15 +0000 (0:00:00.208) 0:02:40.400 ********* 2021-03-09T08:37:16.252 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-03-09T08:37:16.254 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false} 2021-03-09T08:37:16.278 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:16 +0000 (0:00:00.542) 0:02:40.943 ********* 2021-03-09T08:37:16.321 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-03-09T08:37:16.323 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-03-09T08:37:16.356 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:16 +0000 (0:00:00.077) 0:02:41.020 ********* 2021-03-09T08:37:16.536 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-03-09T08:37:16.538 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1615278831.0226176, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1615278831.0186176, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 262873, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1615278831.0186176, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3476867264", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-03-09T08:37:16.566 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:16 +0000 (0:00:00.207) 0:02:41.228 ********* 2021-03-09T08:37:16.761 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-03-09T08:37:16.792 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:16 +0000 (0:00:00.227) 0:02:41.456 ********* 2021-03-09T08:37:16.834 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-03-09T08:37:16.836 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:16.865 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:16 +0000 (0:00:00.073) 0:02:41.530 ********* 2021-03-09T08:37:16.894 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-03-09T08:37:16.896 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-03-09T08:37:16.922 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:16 +0000 (0:00:00.056) 0:02:41.586 ********* 2021-03-09T08:37:16.929 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-03-09T08:37:16.931 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:16.959 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:16 +0000 (0:00:00.037) 0:02:41.624 ********* 2021-03-09T08:37:16.967 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-03-09T08:37:16.969 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-03-09T08:37:17.011 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:17 +0000 (0:00:00.051) 0:02:41.676 ********* 2021-03-09T08:37:17.026 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-09T08:37:17.028 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:17.069 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:17 +0000 (0:00:00.057) 0:02:41.733 ********* 2021-03-09T08:37:17.081 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-03-09T08:37:17.083 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:17.113 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:17 +0000 (0:00:00.043) 0:02:41.777 ********* 2021-03-09T08:37:17.123 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:17.153 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:17 +0000 (0:00:00.040) 0:02:41.818 ********* 2021-03-09T08:37:17.260 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-03-09T08:37:17.261 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-03-09T08:37:17.285 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:17 +0000 (0:00:00.131) 0:02:41.950 ********* 2021-03-09T08:37:17.392 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-03-09T08:37:17.394 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-03-09T08:37:17.419 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:17 +0000 (0:00:00.133) 0:02:42.083 ********* 2021-03-09T08:37:17.437 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:17.438 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi091.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-03-09T08:37:17.462 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:17 +0000 (0:00:00.043) 0:02:42.127 ********* 2021-03-09T08:37:17.489 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-03-09T08:37:17.491 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:17.513 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:17 +0000 (0:00:00.050) 0:02:42.178 ********* 2021-03-09T08:37:17.552 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-03-09T08:37:17.553 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-03-09T08:37:17.573 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-03-09T08:37:17.575 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi091.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-03-09T08:37:17.576 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-03-09T08:37:17.605 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:17 +0000 (0:00:00.092) 0:02:42.270 ********* 2021-03-09T08:37:17.614 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-03-09T08:37:17.646 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:17 +0000 (0:00:00.040) 0:02:42.310 ********* 2021-03-09T08:37:17.702 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-03-09T08:37:17.703 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:17.705 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:17.715 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:17.726 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:17.737 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:17.764 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:17 +0000 (0:00:00.117) 0:02:42.428 ********* 2021-03-09T08:37:17.791 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-09T08:37:17.793 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:17.818 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:17 +0000 (0:00:00.054) 0:02:42.483 ********* 2021-03-09T08:37:17.857 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-03-09T08:37:17.859 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:17.882 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:17 +0000 (0:00:00.063) 0:02:42.546 ********* 2021-03-09T08:37:17.921 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:17.950 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:17 +0000 (0:00:00.067) 0:02:42.614 ********* 2021-03-09T08:37:17.990 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:17.992 INFO:teuthology.task.ansible.out:TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:18.017 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:18 +0000 (0:00:00.067) 0:02:42.682 ********* 2021-03-09T08:37:18.026 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-03-09T08:37:18.029 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-03-09T08:37:18.057 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:18 +0000 (0:00:00.039) 0:02:42.722 ********* 2021-03-09T08:37:18.064 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-03-09T08:37:18.066 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:18.096 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:18 +0000 (0:00:00.038) 0:02:42.760 ********* 2021-03-09T08:37:18.134 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-09T08:37:18.136 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:18.165 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:18 +0000 (0:00:00.069) 0:02:42.829 ********* 2021-03-09T08:37:18.217 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-03-09T08:37:18.219 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:18.243 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:18 +0000 (0:00:00.078) 0:02:42.908 ********* 2021-03-09T08:37:18.281 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-09T08:37:18.283 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:18.314 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:18 +0000 (0:00:00.070) 0:02:42.978 ********* 2021-03-09T08:37:18.446 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-03-09T08:37:18.448 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-03-09T08:37:18.481 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:18 +0000 (0:00:00.167) 0:02:43.146 ********* 2021-03-09T08:37:18.522 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-09T08:37:18.523 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010894", "end": "2021-03-09 08:37:18.465483", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-03-09 08:37:18.454589", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:18.655 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006013", "end": "2021-03-09 08:37:18.625863", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-03-09 08:37:18.619850", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:18.793 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005494", "end": "2021-03-09 08:37:18.760822", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-03-09 08:37:18.755328", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:18.911 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.007782", "end": "2021-03-09 08:37:18.885930", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-03-09 08:37:18.878148", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:18.939 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:18 +0000 (0:00:00.457) 0:02:43.604 ********* 2021-03-09T08:37:18.968 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-03-09T08:37:18.995 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:18 +0000 (0:00:00.055) 0:02:43.659 ********* 2021-03-09T08:37:19.162 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-03-09T08:37:19.164 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-03-09T08:37:19.427 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-03-09T08:37:19.429 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1615278864, "cache_updated": false, "changed": false} 2021-03-09T08:37:19.455 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:19 +0000 (0:00:00.460) 0:02:44.120 ********* 2021-03-09T08:37:19.457 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:19.659 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-03-09T08:37:19.662 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.048349", "end": "2021-03-09 08:37:19.628839", "rc": 0, "start": "2021-03-09 08:37:19.580490", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-03-09T08:37:19.689 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:19 +0000 (0:00:00.233) 0:02:44.353 ********* 2021-03-09T08:37:19.727 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-03-09T08:37:19.729 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:19.751 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:19 +0000 (0:00:00.062) 0:02:44.416 ********* 2021-03-09T08:37:19.783 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-03-09T08:37:19.784 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:19.809 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:19 +0000 (0:00:00.057) 0:02:44.474 ********* 2021-03-09T08:37:20.733 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-03-09T08:37:20.735 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1615278864, "cache_updated": false, "changed": false} 2021-03-09T08:37:20.757 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:20 +0000 (0:00:00.947) 0:02:45.421 ********* 2021-03-09T08:37:20.798 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-03-09T08:37:20.800 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:20.824 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:20 +0000 (0:00:00.067) 0:02:45.489 ********* 2021-03-09T08:37:21.261 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-03-09T08:37:21.263 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-03-09T08:37:21.301 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:21 +0000 (0:00:00.476) 0:02:45.965 ********* 2021-03-09T08:37:21.346 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-03-09T08:37:21.348 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:21.384 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:21 +0000 (0:00:00.083) 0:02:46.049 ********* 2021-03-09T08:37:21.627 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-03-09T08:37:21.628 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2021-03-09 08:33:23 UTC", "ActiveEnterTimestampMonotonic": "16822063", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target systemd-tmpfiles-setup.service -.mount systemd-journald.socket system.slice basic.target network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2021-03-09 08:33:23 UTC", "AssertTimestampMonotonic": "16672082", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2021-03-09 08:33:23 UTC", "ConditionTimestampMonotonic": "16672082", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2021-03-09T08:37:21.629 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1174", "ExecMainStartTimestamp": "Tue 2021-03-09 08:33:23 UTC", "ExecMainStartTimestampMonotonic": "16822052", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2021-03-09 08:33:23 UTC", "InactiveExitTimestampMonotonic": "16672869", "InvocationID": "d2b18336d23242fa84c9008f3f24c12e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2021-03-09T08:37:21.631 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1174", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2021-03-09 08:33:23 UTC", "S 2021-03-09T08:37:21.633 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "16822063", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2021-03-09 08:33:23 UTC", "WatchdogTimestampMonotonic": "16822062", "WatchdogUSec": "0"}} 2021-03-09T08:37:21.653 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:21 +0000 (0:00:00.268) 0:02:46.317 ********* 2021-03-09T08:37:21.703 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-03-09T08:37:21.726 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:21 +0000 (0:00:00.072) 0:02:46.390 ********* 2021-03-09T08:37:21.764 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-09T08:37:21.766 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:21.788 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:21 +0000 (0:00:00.062) 0:02:46.453 ********* 2021-03-09T08:37:21.816 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-03-09T08:37:21.818 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:21.840 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:21 +0000 (0:00:00.051) 0:02:46.504 ********* 2021-03-09T08:37:22.784 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:22.786 INFO:teuthology.task.ansible.out:TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1615278864, "cache_updated": false, "changed": false} 2021-03-09T08:37:22.811 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:22 +0000 (0:00:00.971) 0:02:47.476 ********* 2021-03-09T08:37:22.843 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-03-09T08:37:22.846 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:22.870 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:22 +0000 (0:00:00.059) 0:02:47.535 ********* 2021-03-09T08:37:22.872 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:23.063 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-03-09T08:37:23.087 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:23 +0000 (0:00:00.216) 0:02:47.751 ********* 2021-03-09T08:37:23.088 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:23.676 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-03-09T08:37:23.715 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:23 +0000 (0:00:00.628) 0:02:48.380 ********* 2021-03-09T08:37:24.527 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-03-09T08:37:24.529 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-03-09T08:37:24.552 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:24 +0000 (0:00:00.837) 0:02:49.217 ********* 2021-03-09T08:37:25.064 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-03-09T08:37:25.066 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false} 2021-03-09T08:37:25.107 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:25 +0000 (0:00:00.554) 0:02:49.772 ********* 2021-03-09T08:37:25.163 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-03-09T08:37:25.164 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-03-09T08:37:25.202 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:25 +0000 (0:00:00.094) 0:02:49.867 ********* 2021-03-09T08:37:25.398 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-03-09T08:37:25.400 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1615278824.502702, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1615278824.498702, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 262873, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1615278824.498702, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3476867264", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-03-09T08:37:25.424 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:25 +0000 (0:00:00.222) 0:02:50.089 ********* 2021-03-09T08:37:25.656 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-03-09T08:37:25.658 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-03-09T08:37:25.684 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:25 +0000 (0:00:00.260) 0:02:50.349 ********* 2021-03-09T08:37:25.729 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-03-09T08:37:25.734 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-03-09T08:37:25.754 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:25 +0000 (0:00:00.070) 0:02:50.419 ********* 2021-03-09T08:37:25.793 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-03-09T08:37:25.795 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:25.829 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:25 +0000 (0:00:00.074) 0:02:50.493 ********* 2021-03-09T08:37:26.043 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-03-09T08:37:26.045 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-03-09T08:37:26.075 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:26 +0000 (0:00:00.245) 0:02:50.739 ********* 2021-03-09T08:37:26.249 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-03-09T08:37:26.252 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-03-09T08:37:26.274 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:26 +0000 (0:00:00.199) 0:02:50.939 ********* 2021-03-09T08:37:26.334 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-03-09T08:37:26.336 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:26.359 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:26 +0000 (0:00:00.084) 0:02:51.023 ********* 2021-03-09T08:37:26.409 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-03-09T08:37:26.412 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-03-09T08:37:26.412 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-03-09T08:37:26.428 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-03-09T08:37:26.492 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:26 +0000 (0:00:00.133) 0:02:51.156 ********* 2021-03-09T08:37:26.570 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-03-09T08:37:26.572 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:26.582 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:26.587 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:26.587 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:26.624 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:26 +0000 (0:00:00.131) 0:02:51.288 ********* 2021-03-09T08:37:26.654 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:26.656 INFO:teuthology.task.ansible.out:TASK [testnode : set_fact] ***************************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:26.684 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:26 +0000 (0:00:00.060) 0:02:51.349 ********* 2021-03-09T08:37:26.723 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-03-09T08:37:26.725 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:26.747 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:26 +0000 (0:00:00.062) 0:02:51.412 ********* 2021-03-09T08:37:26.776 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-03-09T08:37:26.778 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:26.805 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:26 +0000 (0:00:00.057) 0:02:51.470 ********* 2021-03-09T08:37:26.843 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-03-09T08:37:26.845 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:26.868 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:26 +0000 (0:00:00.063) 0:02:51.533 ********* 2021-03-09T08:37:26.896 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-03-09T08:37:26.898 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:26.925 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:26 +0000 (0:00:00.056) 0:02:51.590 ********* 2021-03-09T08:37:26.955 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-09T08:37:26.957 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:26.981 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:26 +0000 (0:00:00.056) 0:02:51.646 ********* 2021-03-09T08:37:27.030 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:27.057 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:27 +0000 (0:00:00.075) 0:02:51.722 ********* 2021-03-09T08:37:27.085 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-09T08:37:27.087 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:27.109 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:27 +0000 (0:00:00.051) 0:02:51.773 ********* 2021-03-09T08:37:27.284 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi106.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010991", "end": "2021-03-09 08:37:27.246200", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-03-09 08:37:27.235209", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:27.411 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006029", "end": "2021-03-09 08:37:27.380161", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-03-09 08:37:27.374132", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:27.529 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005133", "end": "2021-03-09 08:37:27.498733", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-03-09 08:37:27.493600", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:27.656 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.007631", "end": "2021-03-09 08:37:27.628237", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-03-09 08:37:27.620606", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:27.681 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:27 +0000 (0:00:00.572) 0:02:52.346 ********* 2021-03-09T08:37:27.709 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-03-09T08:37:27.733 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:27 +0000 (0:00:00.051) 0:02:52.398 ********* 2021-03-09T08:37:27.876 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-03-09T08:37:27.878 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-03-09T08:37:27.965 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-03-09T08:37:27.988 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:27 +0000 (0:00:00.255) 0:02:52.653 ********* 2021-03-09T08:37:28.017 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:28 +0000 (0:00:00.027) 0:02:52.680 ********* 2021-03-09T08:37:28.749 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-03-09T08:37:28.750 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] 2021-03-09T08:37:28.804 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:28 +0000 (0:00:00.788) 0:02:53.468 ********* 2021-03-09T08:37:28.818 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] 2021-03-09T08:37:28.856 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi091.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-03-09T08:37:28.885 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:28 +0000 (0:00:00.081) 0:02:53.550 ********* 2021-03-09T08:37:28.910 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:28 +0000 (0:00:00.025) 0:02:53.575 ********* 2021-03-09T08:37:28.918 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-09T08:37:28.920 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:28.945 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:28 +0000 (0:00:00.034) 0:02:53.610 ********* 2021-03-09T08:37:28.952 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-09T08:37:28.954 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-03-09T08:37:28.981 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:28 +0000 (0:00:00.035) 0:02:53.645 ********* 2021-03-09T08:37:28.999 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** ok: [smithi091.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-03-09T08:37:29.001 INFO:teuthology.task.ansible.out: 2021-03-09T08:37:29.025 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:29 +0000 (0:00:00.044) 0:02:53.690 ********* 2021-03-09T08:37:29.034 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:29.060 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:29 +0000 (0:00:00.035) 0:02:53.725 ********* 2021-03-09T08:37:29.120 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-03-09T08:37:29.122 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-03-09T08:37:29.146 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:29 +0000 (0:00:00.085) 0:02:53.810 ********* 2021-03-09T08:37:29.953 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-03-09T08:37:29.955 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"cache_update_time": 1615278859, "cache_updated": false, "changed": false} 2021-03-09T08:37:29.999 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:29 +0000 (0:00:00.852) 0:02:54.662 ********* 2021-03-09T08:37:30.049 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-09T08:37:30.051 INFO:teuthology.task.ansible.out:skipping: [smithi091.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [container-host : Install container packages] ***************************** ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1615278864, "cache_updated": false, "changed": false} 2021-03-09T08:37:30.076 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:30 +0000 (0:00:00.077) 0:02:54.740 ********* 2021-03-09T08:37:30.102 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:30 +0000 (0:00:00.025) 0:02:54.766 ********* 2021-03-09T08:37:30.162 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-09T08:37:30.164 INFO:teuthology.task.ansible.out:ok: [smithi091.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} TASK [container-host : set_fact] *********************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-09T08:37:30.190 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:30 +0000 (0:00:00.088) 0:02:54.855 ********* 2021-03-09T08:37:30.217 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:30 +0000 (0:00:00.027) 0:02:54.882 ********* 2021-03-09T08:37:30.303 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-09T08:37:30.304 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-03-09T08:37:30.327 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:30 +0000 (0:00:00.109) 0:02:54.991 ********* 2021-03-09T08:37:30.424 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-03-09T08:37:30.426 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-09T08:37:30.530 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-09T08:37:30.553 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-09T08:37:30.585 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:30 +0000 (0:00:00.257) 0:02:55.249 ********* 2021-03-09T08:37:30.673 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-09T08:37:30.704 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:30 +0000 (0:00:00.119) 0:02:55.369 ********* 2021-03-09T08:37:31.047 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-03-09T08:37:31.049 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615279050.6899445-27828-200484044318597/source", "state": "file", "uid": 0} 2021-03-09T08:37:31.175 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615279050.7938187-27846-198449681427227/source", "state": "file", "uid": 0} 2021-03-09T08:37:31.452 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615279051.0872567-27828-235091807812726/source", "state": "file", "uid": 0} 2021-03-09T08:37:31.480 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:31 +0000 (0:00:00.775) 0:02:56.144 ********* 2021-03-09T08:37:31.599 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615279051.2119756-27846-269003870741771/source", "state": "file", "uid": 0} 2021-03-09T08:37:31.636 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:31 +0000 (0:00:00.156) 0:02:56.300 ********* 2021-03-09T08:37:35.340 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-03-09T08:37:35.342 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-jstWWy-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-jstWWy-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packag 2021-03-09T08:37:35.343 INFO:teuthology.task.ansible.out:es/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-03-09T08:37:35.364 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:35 +0000 (0:00:03.728) 0:03:00.029 ********* 2021-03-09T08:37:35.527 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-03-09T08:37:35.529 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-03-09T08:37:35.567 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:35 +0000 (0:00:00.202) 0:03:00.231 ********* 2021-03-09T08:37:35.574 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-03-09T08:37:35.575 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-uOH6sz-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-uOH6sz-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packag 2021-03-09T08:37:35.577 INFO:teuthology.task.ansible.out:es/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-03-09T08:37:35.608 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:35 +0000 (0:00:00.040) 0:03:00.272 ********* 2021-03-09T08:37:35.790 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* ok: [smithi091.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-03-09T08:37:35.824 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:35 +0000 (0:00:00.209) 0:03:00.481 ********* 2021-03-09T08:37:36.066 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615279055.645877-28556-236756583384388/source", "state": "file", "uid": 0} 2021-03-09T08:37:36.095 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:36 +0000 (0:00:00.278) 0:03:00.760 ********* 2021-03-09T08:37:36.288 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615279055.9421926-28609-105322404995322/source", "state": "file", "uid": 0} 2021-03-09T08:37:36.329 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:36 +0000 (0:00:00.233) 0:03:00.993 ********* 2021-03-09T08:37:36.480 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-03-09T08:37:36.481 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.206356", "end": "2021-03-09 08:37:36.447524", "rc": 0, "start": "2021-03-09 08:37:36.241168", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:36.514 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:36 +0000 (0:00:00.185) 0:03:01.179 ********* 2021-03-09T08:37:36.664 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.112970", "end": "2021-03-09 08:37:36.619335", "rc": 0, "start": "2021-03-09 08:37:36.506365", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-09T08:37:36.705 INFO:teuthology.task.ansible.out:Tuesday 09 March 2021 08:37:36 +0000 (0:00:00.190) 0:03:01.370 ********* 2021-03-09T08:37:39.901 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-03-09T08:37:39.903 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "docker.socket firewalld.service sysinit.target systemd-journald.socket network-online.target basic.target containerd.service system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMa 2021-03-09T08:37:39.904 INFO:teuthology.task.ansible.out:inStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "12802 2021-03-09T08:37:39.906 INFO:teuthology.task.ansible.out:9", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target docker.socket", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2021-03-09 08:33:47 UTC", "StateChangeTimestampMonotonic": "40560552", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "Su 2021-03-09T08:37:39.907 INFO:teuthology.task.ansible.out:ccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-09T08:37:39.965 INFO:teuthology.task.ansible.out:changed: [smithi091.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "network-online.target sysinit.target docker.socket systemd-journald.socket containerd.service firewalld.service system.slice basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMa 2021-03-09T08:37:39.966 INFO:teuthology.task.ansible.out:inStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128028", "LimitSIGPENDINGSoft": "12802 2021-03-09T08:37:39.968 INFO:teuthology.task.ansible.out:8", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target docker.socket system.slice", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2021-03-09 08:33:53 UTC", "StateChangeTimestampMonotonic": "40058657", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "Su 2021-03-09T08:37:39.970 INFO:teuthology.task.ansible.out:ccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-09T08:37:40.040 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-03-09T08:37:40.041 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-03-09T08:37:40.043 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi091.front.sepia.ceph.com : ok=127 changed=35 unreachable=0 failed=0 skipped=184 rescued=0 ignored=0 smithi106.front.sepia.ceph.com : ok=127 changed=35 unreachable=0 failed=0 skipped=184 rescued=0 ignored=0 Tuesday 09 March 2021 08:37:40 +0000 (0:00:03.337) 0:03:04.707 ********* =============================================================================== 2021-03-09T08:37:40.044 INFO:teuthology.task.ansible.out:Create all admin users with sudo access. ------------------------------- 23.21s users : Update authorized_keys using the keys repo --------------------- 10.07s container-host : Install registries-conf-ctl ---------------------------- 3.73s container-host : Restart docker service --------------------------------- 3.34s testnode : Update apt cache. -------------------------------------------- 2.88s testnode : Install apt keys --------------------------------------------- 2.08s Gathering Facts --------------------------------------------------------- 1.79s users : Clone the keys repo --------------------------------------------- 1.40s testnode : Ensure packages are not present. ----------------------------- 1.40s testnode : Install python-apt ------------------------------------------- 1.00s testnode : Upgrade packages --------------------------------------------- 0.97s testnode : Install python-pip on apt based systems. --------------------- 0.97s testnode : Make sure apt dependencies are installed --------------------- 0.97s common : Set the hardware clock ----------------------------------------- 0.95s testnode : Install ntp package on apt based systems. -------------------- 0.95s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.90s container-host : Install container packages ----------------------------- 0.85s testnode : Install packages via pip ------------------------------------- 0.84s ansible-managed : Add authorized keys for the ansible user. ------------- 0.82s Gathering Facts --------------------------------------------------------- 0.79s 2021-03-09T08:37:40.463 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi091.front.sepia.ceph.com'), Remote(name='ubuntu@smithi106.front.sepia.ceph.com')] 2021-03-09T08:37:40.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-09T08:37:40.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-09T08:37:40.585 DEBUG:teuthology.orchestra.run.smithi091:> true 2021-03-09T08:37:40.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-09T08:37:40.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-09T08:37:40.857 DEBUG:teuthology.orchestra.run.smithi106:> true 2021-03-09T08:37:41.059 INFO:teuthology.run_tasks:Running task clock... 2021-03-09T08:37:41.072 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-03-09T08:37:41.073 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-03-09T08:37:41.074 DEBUG:teuthology.orchestra.run.smithi091:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-03-09T08:37:41.147 INFO:teuthology.orchestra.run.smithi091.stdout: 9 Mar 08:37:41 ntpd[9362]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-03-09T08:37:41.147 INFO:teuthology.orchestra.run.smithi091.stdout: 9 Mar 08:37:41 ntpd[9362]: Command line: ntpd -gq 2021-03-09T08:37:41.148 INFO:teuthology.orchestra.run.smithi091.stdout: 9 Mar 08:37:41 ntpd[9362]: proto: precision = 0.120 usec (-23) 2021-03-09T08:37:41.148 INFO:teuthology.orchestra.run.smithi091.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-09T08:37:41.149 INFO:teuthology.orchestra.run.smithi091.stdout: 9 Mar 08:37:41 ntpd[9362]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-09T08:37:41.149 INFO:teuthology.orchestra.run.smithi091.stderr:restrict ::: KOD does nothing without LIMITED. 2021-03-09T08:37:41.151 INFO:teuthology.orchestra.run.smithi091.stdout: 9 Mar 08:37:41 ntpd[9362]: restrict ::: KOD does nothing without LIMITED. 2021-03-09T08:37:41.151 INFO:teuthology.orchestra.run.smithi091.stdout: 9 Mar 08:37:41 ntpd[9362]: Listen and drop on 0 v6wildcard [::]:123 2021-03-09T08:37:41.151 INFO:teuthology.orchestra.run.smithi091.stdout: 9 Mar 08:37:41 ntpd[9362]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-03-09T08:37:41.151 INFO:teuthology.orchestra.run.smithi091.stdout: 9 Mar 08:37:41 ntpd[9362]: Listen normally on 2 lo 127.0.0.1:123 2021-03-09T08:37:41.152 INFO:teuthology.orchestra.run.smithi091.stdout: 9 Mar 08:37:41 ntpd[9362]: Listen normally on 3 enp3s0f1 172.21.15.91:123 2021-03-09T08:37:41.152 INFO:teuthology.orchestra.run.smithi091.stdout: 9 Mar 08:37:41 ntpd[9362]: Listen normally on 4 lo [::1]:123 2021-03-09T08:37:41.152 INFO:teuthology.orchestra.run.smithi091.stdout: 9 Mar 08:37:41 ntpd[9362]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3d5%5]:123 2021-03-09T08:37:41.152 INFO:teuthology.orchestra.run.smithi091.stdout: 9 Mar 08:37:41 ntpd[9362]: Listening on routing socket on fd #22 for interface updates 2021-03-09T08:37:42.149 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:42 ntpd[9362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:42.149 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:42 ntpd[9362]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:42.149 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:42 ntpd[9362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:42.150 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:42 ntpd[9362]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:42.150 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:42 ntpd[9362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:42.150 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:42 ntpd[9362]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:42.150 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:42 ntpd[9362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:42.150 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:42 ntpd[9362]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:42.151 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:42 ntpd[9362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:42.151 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:42 ntpd[9362]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:42.151 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:42 ntpd[9362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:42.151 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:42 ntpd[9362]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:44.148 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:44 ntpd[9362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:44.149 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:44 ntpd[9362]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:44.149 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:44 ntpd[9362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:44.149 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:44 ntpd[9362]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:44.150 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:44 ntpd[9362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:44.150 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:44 ntpd[9362]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:44.150 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:44 ntpd[9362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:44.150 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:44 ntpd[9362]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:44.151 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:44 ntpd[9362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:44.151 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:44 ntpd[9362]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:44.151 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:44 ntpd[9362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:44.151 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:44 ntpd[9362]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:45.148 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:45 ntpd[9362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:45.148 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:45 ntpd[9362]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:45.148 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:45 ntpd[9362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:45.149 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:45 ntpd[9362]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:46.148 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:46 ntpd[9362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:46.149 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:46 ntpd[9362]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:46.149 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:46 ntpd[9362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:46.149 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:46 ntpd[9362]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:46.150 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:46 ntpd[9362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:46.150 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:46 ntpd[9362]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:46.151 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:46 ntpd[9362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:46.151 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:46 ntpd[9362]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:46.152 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:46 ntpd[9362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:46.153 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:46 ntpd[9362]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:46.153 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:46 ntpd[9362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:46.153 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:46 ntpd[9362]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:47.147 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:47 ntpd[9362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:47.148 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:47 ntpd[9362]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:47.148 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:47 ntpd[9362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:47.148 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:47 ntpd[9362]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:48.147 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:48 ntpd[9362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:48.148 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:48 ntpd[9362]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:48.148 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:48 ntpd[9362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:48.148 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:48 ntpd[9362]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:48.149 INFO:teuthology.orchestra.run.smithi091.stdout: 9 Mar 08:37:48 ntpd[9362]: ntpd: time slew -0.001088 s 2021-03-09T08:37:48.149 INFO:teuthology.orchestra.run.smithi091.stdout:ntpd: time slew -0.001088s 2021-03-09T08:37:48.150 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:48 ntpd[9362]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-03-09T08:37:48.150 INFO:teuthology.orchestra.run.smithi091.stderr: 9 Mar 08:37:48 ntpd[9362]: can't open /var/log/ntpstats/loopstats.20210309: Permission denied 2021-03-09T08:37:48.201 INFO:teuthology.orchestra.run.smithi091.stdout: remote refid st t when poll reach delay offset jitter 2021-03-09T08:37:48.201 INFO:teuthology.orchestra.run.smithi091.stdout:============================================================================== 2021-03-09T08:37:48.201 INFO:teuthology.orchestra.run.smithi091.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-09T08:37:48.201 INFO:teuthology.orchestra.run.smithi091.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-09T08:37:48.202 INFO:teuthology.orchestra.run.smithi091.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-09T08:37:48.202 INFO:teuthology.orchestra.run.smithi091.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-09T08:37:48.202 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-03-09T08:37:48.203 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-03-09T08:37:48.261 INFO:teuthology.orchestra.run.smithi106.stdout: 9 Mar 08:37:48 ntpd[9231]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-03-09T08:37:48.262 INFO:teuthology.orchestra.run.smithi106.stdout: 9 Mar 08:37:48 ntpd[9231]: Command line: ntpd -gq 2021-03-09T08:37:48.262 INFO:teuthology.orchestra.run.smithi106.stdout: 9 Mar 08:37:48 ntpd[9231]: proto: precision = 0.123 usec (-23) 2021-03-09T08:37:48.263 INFO:teuthology.orchestra.run.smithi106.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-09T08:37:48.263 INFO:teuthology.orchestra.run.smithi106.stdout: 9 Mar 08:37:48 ntpd[9231]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-09T08:37:48.264 INFO:teuthology.orchestra.run.smithi106.stdout: 9 Mar 08:37:48 ntpd[9231]: restrict ::: KOD does nothing without LIMITED. 2021-03-09T08:37:48.264 INFO:teuthology.orchestra.run.smithi106.stdout: 9 Mar 08:37:48 ntpd[9231]: Listen and drop on 0 v6wildcard [::]:123 2021-03-09T08:37:48.264 INFO:teuthology.orchestra.run.smithi106.stdout: 9 Mar 08:37:48 ntpd[9231]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-03-09T08:37:48.265 INFO:teuthology.orchestra.run.smithi106.stderr:restrict ::: KOD does nothing without LIMITED. 2021-03-09T08:37:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: 9 Mar 08:37:48 ntpd[9231]: Listen normally on 2 lo 127.0.0.1:123 2021-03-09T08:37:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: 9 Mar 08:37:48 ntpd[9231]: Listen normally on 3 enp3s0f1 172.21.15.106:123 2021-03-09T08:37:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: 9 Mar 08:37:48 ntpd[9231]: Listen normally on 4 lo [::1]:123 2021-03-09T08:37:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: 9 Mar 08:37:48 ntpd[9231]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce6d%5]:123 2021-03-09T08:37:48.268 INFO:teuthology.orchestra.run.smithi106.stdout: 9 Mar 08:37:48 ntpd[9231]: Listening on routing socket on fd #22 for interface updates 2021-03-09T08:37:49.263 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:49 ntpd[9231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:49.263 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:49 ntpd[9231]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:49.264 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:49 ntpd[9231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:49.264 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:49 ntpd[9231]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:51.262 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:51 ntpd[9231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:51.263 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:51 ntpd[9231]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:51.263 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:51 ntpd[9231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:51.263 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:51 ntpd[9231]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:51.263 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:51 ntpd[9231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:51.264 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:51 ntpd[9231]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:51.264 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:51 ntpd[9231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:51.264 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:51 ntpd[9231]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:52.262 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:52 ntpd[9231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:52.262 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:52 ntpd[9231]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:52.263 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:52 ntpd[9231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:52.263 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:52 ntpd[9231]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:53.263 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:53 ntpd[9231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:53.263 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:53 ntpd[9231]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:53.263 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:53 ntpd[9231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:53.264 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:53 ntpd[9231]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:53.264 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:53 ntpd[9231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:53.264 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:53 ntpd[9231]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:53.264 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:53 ntpd[9231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:53.265 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:53 ntpd[9231]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:53.265 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:53 ntpd[9231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:53.265 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:53 ntpd[9231]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:53.265 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:53 ntpd[9231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:53.265 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:53 ntpd[9231]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:54.262 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:54 ntpd[9231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:54.262 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:54 ntpd[9231]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:54.262 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:54 ntpd[9231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:54.263 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:54 ntpd[9231]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:55.264 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:55 ntpd[9231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:55.264 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:55 ntpd[9231]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:55.265 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:55 ntpd[9231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:55.265 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:55 ntpd[9231]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:55.265 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:55 ntpd[9231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-09T08:37:55.266 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:55 ntpd[9231]: can't open /var/log/ntpstats/rawstats.20210309: Permission denied 2021-03-09T08:37:55.267 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:55 ntpd[9231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-09T08:37:55.267 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:55 ntpd[9231]: can't open /var/log/ntpstats/peerstats.20210309: Permission denied 2021-03-09T08:37:55.268 INFO:teuthology.orchestra.run.smithi106.stdout: 9 Mar 08:37:55 ntpd[9231]: ntpd: time slew -0.000011 s 2021-03-09T08:37:55.269 INFO:teuthology.orchestra.run.smithi106.stdout:ntpd: time slew -0.000011s 2021-03-09T08:37:55.270 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:55 ntpd[9231]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-03-09T08:37:55.270 INFO:teuthology.orchestra.run.smithi106.stderr: 9 Mar 08:37:55 ntpd[9231]: can't open /var/log/ntpstats/loopstats.20210309: Permission denied 2021-03-09T08:37:55.379 INFO:teuthology.orchestra.run.smithi106.stdout: remote refid st t when poll reach delay offset jitter 2021-03-09T08:37:55.379 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================== 2021-03-09T08:37:55.379 INFO:teuthology.orchestra.run.smithi106.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-09T08:37:55.379 INFO:teuthology.orchestra.run.smithi106.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-09T08:37:55.380 INFO:teuthology.orchestra.run.smithi106.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-09T08:37:55.380 INFO:teuthology.orchestra.run.smithi106.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-09T08:37:55.381 INFO:teuthology.run_tasks:Running task install... 2021-03-09T08:37:55.395 DEBUG:teuthology.task.install:project ceph 2021-03-09T08:37:55.396 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '89fb622b10ca2e58fe0c913a8956377a886e2ab4'}} 2021-03-09T08:37:55.396 DEBUG:teuthology.task.install:config {'sha1': '89fb622b10ca2e58fe0c913a8956377a886e2ab4'} 2021-03-09T08:37:55.397 INFO:teuthology.task.install:Using flavor: basic 2021-03-09T08:37:55.403 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-03-09T08:37:55.404 INFO:teuthology.task.install:extra packages: [] 2021-03-09T08:37:55.404 DEBUG:teuthology.orchestra.run.smithi091:> sudo lsb_release -is 2021-03-09T08:37:55.460 INFO:teuthology.orchestra.run.smithi091.stdout:Ubuntu 2021-03-09T08:37:55.465 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-03-09T08:37:55.465 DEBUG:teuthology.orchestra.run.smithi106:> sudo lsb_release -is 2021-03-09T08:37:55.466 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-key list | grep Ceph 2021-03-09T08:37:55.518 INFO:teuthology.orchestra.run.smithi106.stdout:Ubuntu 2021-03-09T08:37:55.523 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-03-09T08:37:55.524 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-key list | grep Ceph 2021-03-09T08:37:55.552 INFO:teuthology.orchestra.run.smithi091.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-03-09T08:37:55.617 INFO:teuthology.orchestra.run.smithi106.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-03-09T08:37:55.618 INFO:teuthology.orchestra.run.smithi091.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-03-09T08:37:55.618 INFO:teuthology.orchestra.run.smithi091.stdout:uid [ unknown] Ceph.com (release key) 2021-03-09T08:37:55.620 DEBUG:teuthology.orchestra.run.smithi091:> sudo lsb_release -is 2021-03-09T08:37:55.671 INFO:teuthology.orchestra.run.smithi091.stdout:Ubuntu 2021-03-09T08:37:55.674 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-03-09T08:37:55.674 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-03-09T08:37:55.675 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=89fb622b10ca2e58fe0c913a8956377a886e2ab4 2021-03-09T08:37:55.680 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-03-09T08:37:55.681 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph.com (release key) 2021-03-09T08:37:55.681 DEBUG:teuthology.orchestra.run.smithi106:> sudo lsb_release -is 2021-03-09T08:37:55.727 INFO:teuthology.orchestra.run.smithi106.stdout:Ubuntu 2021-03-09T08:37:55.733 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-03-09T08:37:55.733 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-03-09T08:37:55.733 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=89fb622b10ca2e58fe0c913a8956377a886e2ab4 2021-03-09T08:37:55.829 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default/ 2021-03-09T08:37:55.829 INFO:teuthology.task.install.deb:Package version is 17.0.0-1742-g89fb622b-1bionic 2021-03-09T08:37:55.889 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default/ 2021-03-09T08:37:55.890 INFO:teuthology.task.install.deb:Package version is 17.0.0-1742-g89fb622b-1bionic 2021-03-09T08:37:55.947 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:37:55.947 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-03-09T08:37:55.963 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get update 2021-03-09T08:37:56.009 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:37:56.010 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-03-09T08:37:56.025 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2021-03-09T08:37:56.210 INFO:teuthology.orchestra.run.smithi091.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic InRelease 2021-03-09T08:37:56.233 INFO:teuthology.orchestra.run.smithi091.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic Release [7,681 B] 2021-03-09T08:37:56.258 INFO:teuthology.orchestra.run.smithi091.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic Release.gpg 2021-03-09T08:37:56.267 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic InRelease 2021-03-09T08:37:56.273 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-03-09T08:37:56.273 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:5 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-03-09T08:37:56.281 INFO:teuthology.orchestra.run.smithi091.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,099 B] 2021-03-09T08:37:56.290 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic Release [7,681 B] 2021-03-09T08:37:56.316 INFO:teuthology.orchestra.run.smithi091.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 Packages [16.6 kB] 2021-03-09T08:37:56.325 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:3 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-03-09T08:37:56.325 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-03-09T08:37:56.326 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic Release.gpg 2021-03-09T08:37:56.340 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-03-09T08:37:56.350 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 Packages [16.6 kB] 2021-03-09T08:37:56.383 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,099 B] 2021-03-09T08:37:56.395 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-03-09T08:37:56.420 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-03-09T08:37:56.475 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-03-09T08:37:56.864 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 27.4 kB in 1s (39.3 kB/s) 2021-03-09T08:37:56.929 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 27.4 kB in 1s (38.7 kB/s) 2021-03-09T08:37:58.104 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2021-03-09T08:37:58.153 DEBUG:teuthology.orchestra.run.smithi091:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-1742-g89fb622b-1bionic cephadm=17.0.0-1742-g89fb622b-1bionic ceph-mds=17.0.0-1742-g89fb622b-1bionic ceph-mgr=17.0.0-1742-g89fb622b-1bionic ceph-common=17.0.0-1742-g89fb622b-1bionic ceph-fuse=17.0.0-1742-g89fb622b-1bionic ceph-test=17.0.0-1742-g89fb622b-1bionic radosgw=17.0.0-1742-g89fb622b-1bionic python3-rados=17.0.0-1742-g89fb622b-1bionic python3-rgw=17.0.0-1742-g89fb622b-1bionic python3-cephfs=17.0.0-1742-g89fb622b-1bionic python3-rbd=17.0.0-1742-g89fb622b-1bionic libcephfs2=17.0.0-1742-g89fb622b-1bionic libcephfs-dev=17.0.0-1742-g89fb622b-1bionic librados2=17.0.0-1742-g89fb622b-1bionic librbd1=17.0.0-1742-g89fb622b-1bionic rbd-fuse=17.0.0-1742-g89fb622b-1bionic 2021-03-09T08:37:58.177 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2021-03-09T08:37:58.222 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-1742-g89fb622b-1bionic cephadm=17.0.0-1742-g89fb622b-1bionic ceph-mds=17.0.0-1742-g89fb622b-1bionic ceph-mgr=17.0.0-1742-g89fb622b-1bionic ceph-common=17.0.0-1742-g89fb622b-1bionic ceph-fuse=17.0.0-1742-g89fb622b-1bionic ceph-test=17.0.0-1742-g89fb622b-1bionic radosgw=17.0.0-1742-g89fb622b-1bionic python3-rados=17.0.0-1742-g89fb622b-1bionic python3-rgw=17.0.0-1742-g89fb622b-1bionic python3-cephfs=17.0.0-1742-g89fb622b-1bionic python3-rbd=17.0.0-1742-g89fb622b-1bionic libcephfs2=17.0.0-1742-g89fb622b-1bionic libcephfs-dev=17.0.0-1742-g89fb622b-1bionic librados2=17.0.0-1742-g89fb622b-1bionic librbd1=17.0.0-1742-g89fb622b-1bionic rbd-fuse=17.0.0-1742-g89fb622b-1bionic 2021-03-09T08:37:58.235 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2021-03-09T08:37:58.305 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2021-03-09T08:37:58.478 INFO:teuthology.orchestra.run.smithi091.stdout:Building dependency tree... 2021-03-09T08:37:58.479 INFO:teuthology.orchestra.run.smithi091.stdout:Reading state information... 2021-03-09T08:37:58.551 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2021-03-09T08:37:58.552 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2021-03-09T08:37:58.644 INFO:teuthology.orchestra.run.smithi091.stdout:The following additional packages will be installed: 2021-03-09T08:37:58.645 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-03-09T08:37:58.645 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2021-03-09T08:37:58.645 INFO:teuthology.orchestra.run.smithi091.stdout: libjaeger libjq1 libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2021-03-09T08:37:58.646 INFO:teuthology.orchestra.run.smithi091.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 nvme-cli 2021-03-09T08:37:58.647 INFO:teuthology.orchestra.run.smithi091.stdout: python-attr python-funcsigs python-pastedeploy-tpl python-pluggy python-py 2021-03-09T08:37:58.647 INFO:teuthology.orchestra.run.smithi091.stdout: python-pytest python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2021-03-09T08:37:58.647 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2021-03-09T08:37:58.647 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cherrypy3 python3-cryptography python3-cycler python3-dateutil 2021-03-09T08:37:58.648 INFO:teuthology.orchestra.run.smithi091.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2021-03-09T08:37:58.648 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-03-09T08:37:58.648 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-03-09T08:37:58.648 INFO:teuthology.orchestra.run.smithi091.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2021-03-09T08:37:58.648 INFO:teuthology.orchestra.run.smithi091.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2021-03-09T08:37:58.649 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2021-03-09T08:37:58.649 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2021-03-09T08:37:58.649 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2021-03-09T08:37:58.649 INFO:teuthology.orchestra.run.smithi091.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2021-03-09T08:37:58.650 INFO:teuthology.orchestra.run.smithi091.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2021-03-09T08:37:58.652 INFO:teuthology.orchestra.run.smithi091.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2021-03-09T08:37:58.653 INFO:teuthology.orchestra.run.smithi091.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2021-03-09T08:37:58.653 INFO:teuthology.orchestra.run.smithi091.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2021-03-09T08:37:58.653 INFO:teuthology.orchestra.run.smithi091.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-03-09T08:37:58.654 INFO:teuthology.orchestra.run.smithi091.stdout:Suggested packages: 2021-03-09T08:37:58.654 INFO:teuthology.orchestra.run.smithi091.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2021-03-09T08:37:58.654 INFO:teuthology.orchestra.run.smithi091.stdout: python-pytest-xdist python-mock python-cryptography-doc 2021-03-09T08:37:58.654 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2021-03-09T08:37:58.655 INFO:teuthology.orchestra.run.smithi091.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2021-03-09T08:37:58.655 INFO:teuthology.orchestra.run.smithi091.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2021-03-09T08:37:58.655 INFO:teuthology.orchestra.run.smithi091.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2021-03-09T08:37:58.655 INFO:teuthology.orchestra.run.smithi091.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2021-03-09T08:37:58.656 INFO:teuthology.orchestra.run.smithi091.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2021-03-09T08:37:58.656 INFO:teuthology.orchestra.run.smithi091.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2021-03-09T08:37:58.656 INFO:teuthology.orchestra.run.smithi091.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2021-03-09T08:37:58.656 INFO:teuthology.orchestra.run.smithi091.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2021-03-09T08:37:58.656 INFO:teuthology.orchestra.run.smithi091.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2021-03-09T08:37:58.657 INFO:teuthology.orchestra.run.smithi091.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2021-03-09T08:37:58.657 INFO:teuthology.orchestra.run.smithi091.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2021-03-09T08:37:58.657 INFO:teuthology.orchestra.run.smithi091.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2021-03-09T08:37:58.720 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2021-03-09T08:37:58.721 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-03-09T08:37:58.721 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2021-03-09T08:37:58.721 INFO:teuthology.orchestra.run.smithi106.stdout: libjaeger libjq1 libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2021-03-09T08:37:58.721 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 nvme-cli 2021-03-09T08:37:58.722 INFO:teuthology.orchestra.run.smithi106.stdout: python-attr python-funcsigs python-pastedeploy-tpl python-pluggy python-py 2021-03-09T08:37:58.722 INFO:teuthology.orchestra.run.smithi106.stdout: python-pytest python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2021-03-09T08:37:58.722 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2021-03-09T08:37:58.722 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy3 python3-cryptography python3-cycler python3-dateutil 2021-03-09T08:37:58.723 INFO:teuthology.orchestra.run.smithi106.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2021-03-09T08:37:58.723 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-03-09T08:37:58.723 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-03-09T08:37:58.723 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2021-03-09T08:37:58.723 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2021-03-09T08:37:58.724 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2021-03-09T08:37:58.724 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2021-03-09T08:37:58.724 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2021-03-09T08:37:58.724 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2021-03-09T08:37:58.724 INFO:teuthology.orchestra.run.smithi106.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2021-03-09T08:37:58.725 INFO:teuthology.orchestra.run.smithi106.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2021-03-09T08:37:58.725 INFO:teuthology.orchestra.run.smithi106.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2021-03-09T08:37:58.725 INFO:teuthology.orchestra.run.smithi106.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2021-03-09T08:37:58.725 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-03-09T08:37:58.726 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2021-03-09T08:37:58.726 INFO:teuthology.orchestra.run.smithi106.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2021-03-09T08:37:58.726 INFO:teuthology.orchestra.run.smithi106.stdout: python-pytest-xdist python-mock python-cryptography-doc 2021-03-09T08:37:58.726 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2021-03-09T08:37:58.727 INFO:teuthology.orchestra.run.smithi106.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2021-03-09T08:37:58.727 INFO:teuthology.orchestra.run.smithi106.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2021-03-09T08:37:58.727 INFO:teuthology.orchestra.run.smithi106.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2021-03-09T08:37:58.727 INFO:teuthology.orchestra.run.smithi106.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2021-03-09T08:37:58.728 INFO:teuthology.orchestra.run.smithi106.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2021-03-09T08:37:58.728 INFO:teuthology.orchestra.run.smithi106.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2021-03-09T08:37:58.728 INFO:teuthology.orchestra.run.smithi106.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2021-03-09T08:37:58.728 INFO:teuthology.orchestra.run.smithi106.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2021-03-09T08:37:58.728 INFO:teuthology.orchestra.run.smithi106.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2021-03-09T08:37:58.729 INFO:teuthology.orchestra.run.smithi106.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2021-03-09T08:37:58.729 INFO:teuthology.orchestra.run.smithi106.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2021-03-09T08:37:58.729 INFO:teuthology.orchestra.run.smithi106.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2021-03-09T08:37:58.745 INFO:teuthology.orchestra.run.smithi091.stdout:The following NEW packages will be installed: 2021-03-09T08:37:58.745 INFO:teuthology.orchestra.run.smithi091.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-03-09T08:37:58.745 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-03-09T08:37:58.745 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq 2021-03-09T08:37:58.747 INFO:teuthology.orchestra.run.smithi091.stdout: libcephfs-dev libcephfs2 libjaeger libjq1 libleveldb1v5 liblttng-ust0 2021-03-09T08:37:58.747 INFO:teuthology.orchestra.run.smithi091.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-03-09T08:37:58.747 INFO:teuthology.orchestra.run.smithi091.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2021-03-09T08:37:58.747 INFO:teuthology.orchestra.run.smithi091.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2021-03-09T08:37:58.748 INFO:teuthology.orchestra.run.smithi091.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2021-03-09T08:37:58.748 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs 2021-03-09T08:37:58.748 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cffi-backend python3-cherrypy3 python3-cryptography python3-cycler 2021-03-09T08:37:58.748 INFO:teuthology.orchestra.run.smithi091.stdout: python3-dateutil python3-decorator python3-fasteners python3-html5lib 2021-03-09T08:37:58.748 INFO:teuthology.orchestra.run.smithi091.stdout: python3-httplib2 python3-jinja2 python3-joblib python3-json-pointer 2021-03-09T08:37:58.749 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jsonpatch python3-jwt python3-kubernetes python3-logutils 2021-03-09T08:37:58.749 INFO:teuthology.orchestra.run.smithi091.stdout: python3-lxml python3-mako python3-markupsafe python3-matplotlib 2021-03-09T08:37:58.749 INFO:teuthology.orchestra.run.smithi091.stdout: python3-monotonic python3-numpy python3-oauth2client python3-olefile 2021-03-09T08:37:58.749 INFO:teuthology.orchestra.run.smithi091.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2021-03-09T08:37:58.750 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pecan python3-pil python3-pluggy python3-prettytable python3-py 2021-03-09T08:37:58.750 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing 2021-03-09T08:37:58.750 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2021-03-09T08:37:58.750 INFO:teuthology.orchestra.run.smithi091.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2021-03-09T08:37:58.750 INFO:teuthology.orchestra.run.smithi091.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-03-09T08:37:58.751 INFO:teuthology.orchestra.run.smithi091.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2021-03-09T08:37:58.751 INFO:teuthology.orchestra.run.smithi091.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2021-03-09T08:37:58.751 INFO:teuthology.orchestra.run.smithi091.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2021-03-09T08:37:58.751 INFO:teuthology.orchestra.run.smithi091.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-03-09T08:37:58.752 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages will be upgraded: 2021-03-09T08:37:58.752 INFO:teuthology.orchestra.run.smithi091.stdout: librados2 librbd1 2021-03-09T08:37:58.822 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2021-03-09T08:37:58.823 INFO:teuthology.orchestra.run.smithi106.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-03-09T08:37:58.823 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-03-09T08:37:58.825 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq 2021-03-09T08:37:58.825 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-dev libcephfs2 libjaeger libjq1 libleveldb1v5 liblttng-ust0 2021-03-09T08:37:58.825 INFO:teuthology.orchestra.run.smithi106.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-03-09T08:37:58.826 INFO:teuthology.orchestra.run.smithi106.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2021-03-09T08:37:58.826 INFO:teuthology.orchestra.run.smithi106.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2021-03-09T08:37:58.826 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2021-03-09T08:37:58.826 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs 2021-03-09T08:37:58.826 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi-backend python3-cherrypy3 python3-cryptography python3-cycler 2021-03-09T08:37:58.827 INFO:teuthology.orchestra.run.smithi106.stdout: python3-dateutil python3-decorator python3-fasteners python3-html5lib 2021-03-09T08:37:58.827 INFO:teuthology.orchestra.run.smithi106.stdout: python3-httplib2 python3-jinja2 python3-joblib python3-json-pointer 2021-03-09T08:37:58.827 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch python3-jwt python3-kubernetes python3-logutils 2021-03-09T08:37:58.828 INFO:teuthology.orchestra.run.smithi106.stdout: python3-lxml python3-mako python3-markupsafe python3-matplotlib 2021-03-09T08:37:58.828 INFO:teuthology.orchestra.run.smithi106.stdout: python3-monotonic python3-numpy python3-oauth2client python3-olefile 2021-03-09T08:37:58.828 INFO:teuthology.orchestra.run.smithi106.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2021-03-09T08:37:58.828 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan python3-pil python3-pluggy python3-prettytable python3-py 2021-03-09T08:37:58.829 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing 2021-03-09T08:37:58.829 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2021-03-09T08:37:58.829 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2021-03-09T08:37:58.829 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-03-09T08:37:58.829 INFO:teuthology.orchestra.run.smithi106.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2021-03-09T08:37:58.830 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2021-03-09T08:37:58.830 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2021-03-09T08:37:58.830 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-03-09T08:37:58.831 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages will be upgraded: 2021-03-09T08:37:58.831 INFO:teuthology.orchestra.run.smithi106.stdout: librados2 librbd1 2021-03-09T08:37:58.879 INFO:teuthology.orchestra.run.smithi091.stdout:2 upgraded, 111 newly installed, 0 to remove and 15 not upgraded. 2021-03-09T08:37:58.880 INFO:teuthology.orchestra.run.smithi091.stdout:Need to get 166 MB of archives. 2021-03-09T08:37:58.880 INFO:teuthology.orchestra.run.smithi091.stdout:After this operation, 778 MB of additional disk space will be used. 2021-03-09T08:37:58.880 INFO:teuthology.orchestra.run.smithi091.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 libjaeger amd64 17.0.0-1742-g89fb622b-1bionic [3,728 B] 2021-03-09T08:37:58.925 INFO:teuthology.orchestra.run.smithi091.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 17.0.0-1742-g89fb622b-1bionic [3,126 kB] 2021-03-09T08:37:58.933 INFO:teuthology.orchestra.run.smithi091.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2021-03-09T08:37:58.964 INFO:teuthology.orchestra.run.smithi106.stdout:2 upgraded, 111 newly installed, 0 to remove and 15 not upgraded. 2021-03-09T08:37:58.965 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 166 MB of archives. 2021-03-09T08:37:58.965 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 778 MB of additional disk space will be used. 2021-03-09T08:37:58.965 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 libjaeger amd64 17.0.0-1742-g89fb622b-1bionic [3,728 B] 2021-03-09T08:37:59.009 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 17.0.0-1742-g89fb622b-1bionic [3,126 kB] 2021-03-09T08:37:59.011 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2021-03-09T08:37:59.014 INFO:teuthology.orchestra.run.smithi091.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-03-09T08:37:59.091 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-03-09T08:37:59.125 INFO:teuthology.orchestra.run.smithi091.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 17.0.0-1742-g89fb622b-1bionic [3,169 kB] 2021-03-09T08:37:59.250 INFO:teuthology.orchestra.run.smithi091.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 17.0.0-1742-g89fb622b-1bionic [665 kB] 2021-03-09T08:37:59.268 INFO:teuthology.orchestra.run.smithi091.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2021-03-09T08:37:59.272 INFO:teuthology.orchestra.run.smithi091.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 17.0.0-1742-g89fb622b-1bionic [340 kB] 2021-03-09T08:37:59.281 INFO:teuthology.orchestra.run.smithi091.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-03-09T08:37:59.283 INFO:teuthology.orchestra.run.smithi091.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 17.0.0-1742-g89fb622b-1bionic [21.7 kB] 2021-03-09T08:37:59.284 INFO:teuthology.orchestra.run.smithi091.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 17.0.0-1742-g89fb622b-1bionic [163 kB] 2021-03-09T08:37:59.289 INFO:teuthology.orchestra.run.smithi091.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 17.0.0-1742-g89fb622b-1bionic [29.4 kB] 2021-03-09T08:37:59.290 INFO:teuthology.orchestra.run.smithi091.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 17.0.0-1742-g89fb622b-1bionic [336 kB] 2021-03-09T08:37:59.299 INFO:teuthology.orchestra.run.smithi091.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2021-03-09T08:37:59.302 INFO:teuthology.orchestra.run.smithi091.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 17.0.0-1742-g89fb622b-1bionic [3,311 kB] 2021-03-09T08:37:59.351 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2021-03-09T08:37:59.358 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-03-09T08:37:59.376 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2021-03-09T08:37:59.395 INFO:teuthology.orchestra.run.smithi091.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-03-09T08:37:59.398 INFO:teuthology.orchestra.run.smithi091.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-03-09T08:37:59.424 INFO:teuthology.orchestra.run.smithi091.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-03-09T08:37:59.431 INFO:teuthology.orchestra.run.smithi091.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2021-03-09T08:37:59.440 INFO:teuthology.orchestra.run.smithi091.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2021-03-09T08:37:59.452 INFO:teuthology.orchestra.run.smithi091.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2021-03-09T08:37:59.460 INFO:teuthology.orchestra.run.smithi091.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 17.0.0-1742-g89fb622b-1bionic [99.3 kB] 2021-03-09T08:37:59.461 INFO:teuthology.orchestra.run.smithi091.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.4 [220 kB] 2021-03-09T08:37:59.462 INFO:teuthology.orchestra.run.smithi091.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 17.0.0-1742-g89fb622b-1bionic [414 kB] 2021-03-09T08:37:59.467 INFO:teuthology.orchestra.run.smithi091.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 17.0.0-1742-g89fb622b-1bionic [21.2 MB] 2021-03-09T08:37:59.474 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-03-09T08:37:59.477 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-03-09T08:37:59.484 INFO:teuthology.orchestra.run.smithi091.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2021-03-09T08:37:59.488 INFO:teuthology.orchestra.run.smithi091.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2021-03-09T08:37:59.507 INFO:teuthology.orchestra.run.smithi091.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2021-03-09T08:37:59.515 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-03-09T08:37:59.519 INFO:teuthology.orchestra.run.smithi091.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2021-03-09T08:37:59.519 INFO:teuthology.orchestra.run.smithi091.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2021-03-09T08:37:59.522 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2021-03-09T08:37:59.529 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2021-03-09T08:37:59.539 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2021-03-09T08:37:59.547 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.4 [220 kB] 2021-03-09T08:37:59.574 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2021-03-09T08:37:59.579 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2021-03-09T08:37:59.587 INFO:teuthology.orchestra.run.smithi091.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2021-03-09T08:37:59.587 INFO:teuthology.orchestra.run.smithi091.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2021-03-09T08:37:59.589 INFO:teuthology.orchestra.run.smithi091.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2021-03-09T08:37:59.590 INFO:teuthology.orchestra.run.smithi091.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2021-03-09T08:37:59.591 INFO:teuthology.orchestra.run.smithi091.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-03-09T08:37:59.602 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2021-03-09T08:37:59.603 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 17.0.0-1742-g89fb622b-1bionic [3,169 kB] 2021-03-09T08:37:59.603 INFO:teuthology.orchestra.run.smithi091.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2021-03-09T08:37:59.603 INFO:teuthology.orchestra.run.smithi091.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2021-03-09T08:37:59.608 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2021-03-09T08:37:59.666 INFO:teuthology.orchestra.run.smithi091.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2021-03-09T08:37:59.667 INFO:teuthology.orchestra.run.smithi091.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-03-09T08:37:59.674 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2021-03-09T08:37:59.675 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2021-03-09T08:37:59.676 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2021-03-09T08:37:59.678 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2021-03-09T08:37:59.679 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2021-03-09T08:37:59.680 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-03-09T08:37:59.682 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2021-03-09T08:37:59.686 INFO:teuthology.orchestra.run.smithi091.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-03-09T08:37:59.745 INFO:teuthology.orchestra.run.smithi091.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2021-03-09T08:37:59.746 INFO:teuthology.orchestra.run.smithi091.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2021-03-09T08:37:59.747 INFO:teuthology.orchestra.run.smithi091.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2021-03-09T08:37:59.751 INFO:teuthology.orchestra.run.smithi091.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-03-09T08:37:59.752 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2021-03-09T08:37:59.754 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2021-03-09T08:37:59.755 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-03-09T08:37:59.758 INFO:teuthology.orchestra.run.smithi091.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2021-03-09T08:37:59.762 INFO:teuthology.orchestra.run.smithi091.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2021-03-09T08:37:59.763 INFO:teuthology.orchestra.run.smithi091.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2021-03-09T08:37:59.825 INFO:teuthology.orchestra.run.smithi091.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2021-03-09T08:37:59.830 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-03-09T08:37:59.831 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2021-03-09T08:37:59.832 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2021-03-09T08:37:59.833 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2021-03-09T08:37:59.836 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-03-09T08:37:59.844 INFO:teuthology.orchestra.run.smithi106.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2021-03-09T08:37:59.849 INFO:teuthology.orchestra.run.smithi106.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2021-03-09T08:37:59.908 INFO:teuthology.orchestra.run.smithi106.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2021-03-09T08:37:59.909 INFO:teuthology.orchestra.run.smithi106.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2021-03-09T08:37:59.911 INFO:teuthology.orchestra.run.smithi091.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2021-03-09T08:37:59.912 INFO:teuthology.orchestra.run.smithi091.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2021-03-09T08:37:59.999 INFO:teuthology.orchestra.run.smithi106.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2021-03-09T08:37:59.999 INFO:teuthology.orchestra.run.smithi106.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2021-03-09T08:38:00.165 INFO:teuthology.orchestra.run.smithi106.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 17.0.0-1742-g89fb622b-1bionic [665 kB] 2021-03-09T08:38:00.187 INFO:teuthology.orchestra.run.smithi091.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2021-03-09T08:38:00.229 INFO:teuthology.orchestra.run.smithi091.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2021-03-09T08:38:00.230 INFO:teuthology.orchestra.run.smithi091.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2021-03-09T08:38:00.265 INFO:teuthology.orchestra.run.smithi091.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2021-03-09T08:38:00.266 INFO:teuthology.orchestra.run.smithi091.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2021-03-09T08:38:00.266 INFO:teuthology.orchestra.run.smithi091.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.3 [28.8 kB] 2021-03-09T08:38:00.267 INFO:teuthology.orchestra.run.smithi091.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2021-03-09T08:38:00.268 INFO:teuthology.orchestra.run.smithi091.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2021-03-09T08:38:00.269 INFO:teuthology.orchestra.run.smithi091.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2021-03-09T08:38:00.269 INFO:teuthology.orchestra.run.smithi091.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2021-03-09T08:38:00.278 INFO:teuthology.orchestra.run.smithi106.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2021-03-09T08:38:00.293 INFO:teuthology.orchestra.run.smithi106.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 17.0.0-1742-g89fb622b-1bionic [340 kB] 2021-03-09T08:38:00.312 INFO:teuthology.orchestra.run.smithi106.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2021-03-09T08:38:00.314 INFO:teuthology.orchestra.run.smithi106.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2021-03-09T08:38:00.322 INFO:teuthology.orchestra.run.smithi091.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 17.0.0-1742-g89fb622b-1bionic [5,646 kB] 2021-03-09T08:38:00.346 INFO:teuthology.orchestra.run.smithi091.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2021-03-09T08:38:00.347 INFO:teuthology.orchestra.run.smithi091.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2021-03-09T08:38:00.352 INFO:teuthology.orchestra.run.smithi091.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-03-09T08:38:00.354 INFO:teuthology.orchestra.run.smithi091.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-03-09T08:38:00.355 INFO:teuthology.orchestra.run.smithi106.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2021-03-09T08:38:00.355 INFO:teuthology.orchestra.run.smithi106.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2021-03-09T08:38:00.356 INFO:teuthology.orchestra.run.smithi106.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.3 [28.8 kB] 2021-03-09T08:38:00.357 INFO:teuthology.orchestra.run.smithi106.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2021-03-09T08:38:00.357 INFO:teuthology.orchestra.run.smithi106.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2021-03-09T08:38:00.358 INFO:teuthology.orchestra.run.smithi106.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2021-03-09T08:38:00.358 INFO:teuthology.orchestra.run.smithi106.stdout:Get:52 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 17.0.0-1742-g89fb622b-1bionic [21.7 kB] 2021-03-09T08:38:00.359 INFO:teuthology.orchestra.run.smithi106.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2021-03-09T08:38:00.359 INFO:teuthology.orchestra.run.smithi106.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 17.0.0-1742-g89fb622b-1bionic [163 kB] 2021-03-09T08:38:00.369 INFO:teuthology.orchestra.run.smithi106.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 17.0.0-1742-g89fb622b-1bionic [29.4 kB] 2021-03-09T08:38:00.372 INFO:teuthology.orchestra.run.smithi106.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 17.0.0-1742-g89fb622b-1bionic [336 kB] 2021-03-09T08:38:00.427 INFO:teuthology.orchestra.run.smithi091.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2021-03-09T08:38:00.428 INFO:teuthology.orchestra.run.smithi091.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2021-03-09T08:38:00.428 INFO:teuthology.orchestra.run.smithi091.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-03-09T08:38:00.431 INFO:teuthology.orchestra.run.smithi091.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-03-09T08:38:00.432 INFO:teuthology.orchestra.run.smithi106.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 17.0.0-1742-g89fb622b-1bionic [3,311 kB] 2021-03-09T08:38:00.434 INFO:teuthology.orchestra.run.smithi091.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-03-09T08:38:00.435 INFO:teuthology.orchestra.run.smithi091.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-03-09T08:38:00.437 INFO:teuthology.orchestra.run.smithi106.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2021-03-09T08:38:00.439 INFO:teuthology.orchestra.run.smithi106.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2021-03-09T08:38:00.447 INFO:teuthology.orchestra.run.smithi106.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-03-09T08:38:00.447 INFO:teuthology.orchestra.run.smithi106.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-03-09T08:38:00.447 INFO:teuthology.orchestra.run.smithi106.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2021-03-09T08:38:00.447 INFO:teuthology.orchestra.run.smithi106.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2021-03-09T08:38:00.505 INFO:teuthology.orchestra.run.smithi091.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-03-09T08:38:00.510 INFO:teuthology.orchestra.run.smithi091.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-03-09T08:38:00.514 INFO:teuthology.orchestra.run.smithi106.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-03-09T08:38:00.523 INFO:teuthology.orchestra.run.smithi091.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-03-09T08:38:00.524 INFO:teuthology.orchestra.run.smithi091.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-03-09T08:38:00.524 INFO:teuthology.orchestra.run.smithi106.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-03-09T08:38:00.524 INFO:teuthology.orchestra.run.smithi106.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-03-09T08:38:00.525 INFO:teuthology.orchestra.run.smithi106.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-03-09T08:38:00.548 INFO:teuthology.orchestra.run.smithi091.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 17.0.0-1742-g89fb622b-1bionic [184 kB] 2021-03-09T08:38:00.553 INFO:teuthology.orchestra.run.smithi091.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 17.0.0-1742-g89fb622b-1bionic [1,388 kB] 2021-03-09T08:38:00.584 INFO:teuthology.orchestra.run.smithi091.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-03-09T08:38:00.585 INFO:teuthology.orchestra.run.smithi091.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-03-09T08:38:00.585 INFO:teuthology.orchestra.run.smithi091.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-03-09T08:38:00.587 INFO:teuthology.orchestra.run.smithi091.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-03-09T08:38:00.590 INFO:teuthology.orchestra.run.smithi091.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2021-03-09T08:38:00.591 INFO:teuthology.orchestra.run.smithi091.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2021-03-09T08:38:00.592 INFO:teuthology.orchestra.run.smithi106.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-03-09T08:38:00.597 INFO:teuthology.orchestra.run.smithi106.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-03-09T08:38:00.604 INFO:teuthology.orchestra.run.smithi106.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-03-09T08:38:00.607 INFO:teuthology.orchestra.run.smithi106.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-03-09T08:38:00.607 INFO:teuthology.orchestra.run.smithi106.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-03-09T08:38:00.608 INFO:teuthology.orchestra.run.smithi106.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-03-09T08:38:00.612 INFO:teuthology.orchestra.run.smithi091.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 17.0.0-1742-g89fb622b-1bionic [6,670 kB] 2021-03-09T08:38:00.664 INFO:teuthology.orchestra.run.smithi091.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2021-03-09T08:38:00.665 INFO:teuthology.orchestra.run.smithi091.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2021-03-09T08:38:00.666 INFO:teuthology.orchestra.run.smithi091.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.3 [1,097 kB] 2021-03-09T08:38:00.670 INFO:teuthology.orchestra.run.smithi106.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-03-09T08:38:00.672 INFO:teuthology.orchestra.run.smithi106.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-03-09T08:38:00.676 INFO:teuthology.orchestra.run.smithi106.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2021-03-09T08:38:00.677 INFO:teuthology.orchestra.run.smithi106.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2021-03-09T08:38:00.687 INFO:teuthology.orchestra.run.smithi091.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-03-09T08:38:00.742 INFO:teuthology.orchestra.run.smithi091.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2021-03-09T08:38:00.743 INFO:teuthology.orchestra.run.smithi091.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2021-03-09T08:38:00.748 INFO:teuthology.orchestra.run.smithi106.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2021-03-09T08:38:00.749 INFO:teuthology.orchestra.run.smithi106.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2021-03-09T08:38:00.752 INFO:teuthology.orchestra.run.smithi106.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.3 [1,097 kB] 2021-03-09T08:38:00.770 INFO:teuthology.orchestra.run.smithi106.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-03-09T08:38:00.771 INFO:teuthology.orchestra.run.smithi106.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2021-03-09T08:38:00.771 INFO:teuthology.orchestra.run.smithi106.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2021-03-09T08:38:00.843 INFO:teuthology.orchestra.run.smithi091.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2021-03-09T08:38:00.843 INFO:teuthology.orchestra.run.smithi091.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2021-03-09T08:38:00.844 INFO:teuthology.orchestra.run.smithi091.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.4 [329 kB] 2021-03-09T08:38:00.848 INFO:teuthology.orchestra.run.smithi091.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2021-03-09T08:38:00.848 INFO:teuthology.orchestra.run.smithi091.stdout:Get:95 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2021-03-09T08:38:00.849 INFO:teuthology.orchestra.run.smithi091.stdout:Get:96 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2021-03-09T08:38:00.849 INFO:teuthology.orchestra.run.smithi091.stdout:Get:97 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2021-03-09T08:38:00.850 INFO:teuthology.orchestra.run.smithi091.stdout:Get:98 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2021-03-09T08:38:00.884 INFO:teuthology.orchestra.run.smithi091.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 17.0.0-1742-g89fb622b-1bionic [24.9 MB] 2021-03-09T08:38:00.900 INFO:teuthology.orchestra.run.smithi091.stdout:Get:100 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2021-03-09T08:38:00.909 INFO:teuthology.orchestra.run.smithi106.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2021-03-09T08:38:00.910 INFO:teuthology.orchestra.run.smithi106.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2021-03-09T08:38:00.910 INFO:teuthology.orchestra.run.smithi106.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.4 [329 kB] 2021-03-09T08:38:00.918 INFO:teuthology.orchestra.run.smithi106.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2021-03-09T08:38:00.919 INFO:teuthology.orchestra.run.smithi106.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2021-03-09T08:38:00.919 INFO:teuthology.orchestra.run.smithi106.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2021-03-09T08:38:00.919 INFO:teuthology.orchestra.run.smithi106.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2021-03-09T08:38:00.920 INFO:teuthology.orchestra.run.smithi106.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2021-03-09T08:38:00.921 INFO:teuthology.orchestra.run.smithi106.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2021-03-09T08:38:01.016 INFO:teuthology.orchestra.run.smithi106.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 17.0.0-1742-g89fb622b-1bionic [99.3 kB] 2021-03-09T08:38:01.045 INFO:teuthology.orchestra.run.smithi106.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 17.0.0-1742-g89fb622b-1bionic [414 kB] 2021-03-09T08:38:01.117 INFO:teuthology.orchestra.run.smithi106.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 17.0.0-1742-g89fb622b-1bionic [21.2 MB] 2021-03-09T08:38:01.896 INFO:teuthology.orchestra.run.smithi091.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 17.0.0-1742-g89fb622b-1bionic [3,812 B] 2021-03-09T08:38:01.897 INFO:teuthology.orchestra.run.smithi091.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 17.0.0-1742-g89fb622b-1bionic [771 kB] 2021-03-09T08:38:01.919 INFO:teuthology.orchestra.run.smithi091.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 17.0.0-1742-g89fb622b-1bionic [2,153 kB] 2021-03-09T08:38:02.014 INFO:teuthology.orchestra.run.smithi091.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 17.0.0-1742-g89fb622b-1bionic [63.1 kB] 2021-03-09T08:38:02.016 INFO:teuthology.orchestra.run.smithi091.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 17.0.0-1742-g89fb622b-1bionic [68.9 kB] 2021-03-09T08:38:02.018 INFO:teuthology.orchestra.run.smithi091.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 17.0.0-1742-g89fb622b-1bionic [2,333 kB] 2021-03-09T08:38:02.110 INFO:teuthology.orchestra.run.smithi091.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 17.0.0-1742-g89fb622b-1bionic [7,881 kB] 2021-03-09T08:38:02.432 INFO:teuthology.orchestra.run.smithi091.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 17.0.0-1742-g89fb622b-1bionic [3,928 B] 2021-03-09T08:38:02.432 INFO:teuthology.orchestra.run.smithi091.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 17.0.0-1742-g89fb622b-1bionic [22.5 kB] 2021-03-09T08:38:02.433 INFO:teuthology.orchestra.run.smithi091.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 17.0.0-1742-g89fb622b-1bionic [45.2 MB] 2021-03-09T08:38:04.246 INFO:teuthology.orchestra.run.smithi091.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 17.0.0-1742-g89fb622b-1bionic [19.9 kB] 2021-03-09T08:38:04.247 INFO:teuthology.orchestra.run.smithi091.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 17.0.0-1742-g89fb622b-1bionic [10.2 MB] 2021-03-09T08:38:04.636 INFO:teuthology.orchestra.run.smithi091.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 17.0.0-1742-g89fb622b-1bionic [77.7 kB] 2021-03-09T08:38:04.740 INFO:teuthology.orchestra.run.smithi106.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 17.0.0-1742-g89fb622b-1bionic [5,646 kB] 2021-03-09T08:38:05.100 INFO:teuthology.orchestra.run.smithi106.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 17.0.0-1742-g89fb622b-1bionic [184 kB] 2021-03-09T08:38:05.118 INFO:teuthology.orchestra.run.smithi106.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 17.0.0-1742-g89fb622b-1bionic [1,388 kB] 2021-03-09T08:38:05.201 INFO:teuthology.orchestra.run.smithi106.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 17.0.0-1742-g89fb622b-1bionic [6,670 kB] 2021-03-09T08:38:05.349 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 166 MB in 6s (28.4 MB/s) 2021-03-09T08:38:05.490 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-uritemplate. 2021-03-09T08:38:05.532 INFO:teuthology.orchestra.run.smithi091.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102065 files and directories currently installed.) 2021-03-09T08:38:05.535 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../000-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2021-03-09T08:38:05.572 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2021-03-09T08:38:05.618 INFO:teuthology.orchestra.run.smithi106.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 17.0.0-1742-g89fb622b-1bionic [24.9 MB] 2021-03-09T08:38:05.816 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libjaeger. 2021-03-09T08:38:05.827 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../001-libjaeger_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:05.866 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libjaeger (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:06.127 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-03-09T08:38:06.137 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../002-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-03-09T08:38:06.227 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-03-09T08:38:06.551 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../003-librbd1_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:06.673 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librbd1 (17.0.0-1742-g89fb622b-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-03-09T08:38:07.088 INFO:teuthology.orchestra.run.smithi106.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 17.0.0-1742-g89fb622b-1bionic [3,812 B] 2021-03-09T08:38:07.088 INFO:teuthology.orchestra.run.smithi106.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 17.0.0-1742-g89fb622b-1bionic [771 kB] 2021-03-09T08:38:07.127 INFO:teuthology.orchestra.run.smithi106.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 17.0.0-1742-g89fb622b-1bionic [2,153 kB] 2021-03-09T08:38:07.250 INFO:teuthology.orchestra.run.smithi106.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 17.0.0-1742-g89fb622b-1bionic [63.1 kB] 2021-03-09T08:38:07.253 INFO:teuthology.orchestra.run.smithi106.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 17.0.0-1742-g89fb622b-1bionic [68.9 kB] 2021-03-09T08:38:07.256 INFO:teuthology.orchestra.run.smithi106.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 17.0.0-1742-g89fb622b-1bionic [2,333 kB] 2021-03-09T08:38:07.330 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../004-librados2_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:07.387 INFO:teuthology.orchestra.run.smithi106.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 17.0.0-1742-g89fb622b-1bionic [7,881 kB] 2021-03-09T08:38:07.452 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librados2 (17.0.0-1742-g89fb622b-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-03-09T08:38:07.813 INFO:teuthology.orchestra.run.smithi106.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 17.0.0-1742-g89fb622b-1bionic [3,928 B] 2021-03-09T08:38:07.814 INFO:teuthology.orchestra.run.smithi106.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 17.0.0-1742-g89fb622b-1bionic [22.5 kB] 2021-03-09T08:38:07.814 INFO:teuthology.orchestra.run.smithi106.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 17.0.0-1742-g89fb622b-1bionic [45.2 MB] 2021-03-09T08:38:08.081 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libcephfs2. 2021-03-09T08:38:08.092 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../005-libcephfs2_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:08.131 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libcephfs2 (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:08.458 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-rados. 2021-03-09T08:38:08.469 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../006-python3-rados_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:08.508 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-rados (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:08.852 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-03-09T08:38:08.863 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../007-python3-ceph-argparse_17.0.0-1742-g89fb622b-1bionic_all.deb ... 2021-03-09T08:38:08.902 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-ceph-argparse (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:09.145 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cephfs. 2021-03-09T08:38:09.157 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../008-python3-cephfs_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:09.187 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cephfs (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:09.523 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-ceph-common. 2021-03-09T08:38:09.534 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../009-python3-ceph-common_17.0.0-1742-g89fb622b-1bionic_all.deb ... 2021-03-09T08:38:09.573 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-ceph-common (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:09.859 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-prettytable. 2021-03-09T08:38:09.871 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../010-python3-prettytable_0.7.2-3_all.deb ... 2021-03-09T08:38:09.909 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2021-03-09T08:38:10.042 INFO:teuthology.orchestra.run.smithi106.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 17.0.0-1742-g89fb622b-1bionic [19.9 kB] 2021-03-09T08:38:10.043 INFO:teuthology.orchestra.run.smithi106.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 17.0.0-1742-g89fb622b-1bionic [10.2 MB] 2021-03-09T08:38:10.162 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-rbd. 2021-03-09T08:38:10.173 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../011-python3-rbd_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:10.212 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-rbd (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:10.501 INFO:teuthology.orchestra.run.smithi106.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-03-09-1428/89fb622b10ca2e58fe0c913a8956377a886e2ab4/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 17.0.0-1742-g89fb622b-1bionic [77.7 kB] 2021-03-09T08:38:10.698 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-03-09T08:38:10.710 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../012-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-03-09T08:38:10.748 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-03-09T08:38:11.042 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-03-09T08:38:11.054 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../013-librdkafka1_0.11.3-1build1_amd64.deb ... 2021-03-09T08:38:11.084 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2021-03-09T08:38:11.208 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 166 MB in 12s (14.3 MB/s) 2021-03-09T08:38:11.352 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-uritemplate. 2021-03-09T08:38:11.391 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102065 files and directories currently installed.) 2021-03-09T08:38:11.394 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../000-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2021-03-09T08:38:11.411 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librgw2. 2021-03-09T08:38:11.423 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../014-librgw2_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:11.434 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2021-03-09T08:38:11.461 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librgw2 (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:11.695 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjaeger. 2021-03-09T08:38:11.708 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../001-libjaeger_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:11.745 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjaeger (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:12.022 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-03-09T08:38:12.035 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../002-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-03-09T08:38:12.039 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-rgw. 2021-03-09T08:38:12.051 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../015-python3-rgw_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:12.089 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-rgw (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:12.114 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-03-09T08:38:12.439 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../003-librbd1_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:12.441 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-03-09T08:38:12.454 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../016-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-03-09T08:38:12.491 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-03-09T08:38:12.560 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librbd1 (17.0.0-1742-g89fb622b-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-03-09T08:38:12.752 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-03-09T08:38:12.765 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../017-libleveldb1v5_1.20-2_amd64.deb ... 2021-03-09T08:38:12.802 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-03-09T08:38:13.147 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package liboath0. 2021-03-09T08:38:13.160 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../018-liboath0_2.6.1-1_amd64.deb ... 2021-03-09T08:38:13.183 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../004-librados2_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:13.196 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-03-09T08:38:13.298 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librados2 (17.0.0-1742-g89fb622b-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-03-09T08:38:13.516 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libradosstriper1. 2021-03-09T08:38:13.528 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../019-libradosstriper1_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:13.566 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libradosstriper1 (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:13.942 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs2. 2021-03-09T08:38:13.955 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../005-libcephfs2_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:13.969 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-common. 2021-03-09T08:38:13.980 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../020-ceph-common_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:13.992 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs2 (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:14.010 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-common (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:14.336 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rados. 2021-03-09T08:38:14.348 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../006-python3-rados_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:14.386 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rados (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:14.664 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-03-09T08:38:14.674 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../007-python3-ceph-argparse_17.0.0-1742-g89fb622b-1bionic_all.deb ... 2021-03-09T08:38:14.714 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-argparse (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:14.974 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cephfs. 2021-03-09T08:38:14.987 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../008-python3-cephfs_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:15.024 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cephfs (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:15.352 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-common. 2021-03-09T08:38:15.363 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../009-python3-ceph-common_17.0.0-1742-g89fb622b-1bionic_all.deb ... 2021-03-09T08:38:15.402 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-common (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:15.704 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-prettytable. 2021-03-09T08:38:15.716 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../010-python3-prettytable_0.7.2-3_all.deb ... 2021-03-09T08:38:15.754 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2021-03-09T08:38:15.932 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-base. 2021-03-09T08:38:15.943 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../021-ceph-base_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:15.990 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rbd. 2021-03-09T08:38:15.991 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-base (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:16.001 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../011-python3-rbd_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:16.032 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rbd (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:16.418 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-03-09T08:38:16.430 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../012-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-03-09T08:38:16.468 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-03-09T08:38:16.796 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-03-09T08:38:16.807 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../013-librdkafka1_0.11.3-1build1_amd64.deb ... 2021-03-09T08:38:16.846 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2021-03-09T08:38:16.903 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-dateutil. 2021-03-09T08:38:16.914 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../022-python3-dateutil_2.6.1-1_all.deb ... 2021-03-09T08:38:16.957 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2021-03-09T08:38:17.156 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librgw2. 2021-03-09T08:38:17.168 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../014-librgw2_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:17.206 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librgw2 (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:17.248 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-asn1crypto. 2021-03-09T08:38:17.260 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../023-python3-asn1crypto_0.24.0-1_all.deb ... 2021-03-09T08:38:17.289 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2021-03-09T08:38:17.517 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cffi-backend. 2021-03-09T08:38:17.527 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../024-python3-cffi-backend_1.11.5-1_amd64.deb ... 2021-03-09T08:38:17.566 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2021-03-09T08:38:17.759 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rgw. 2021-03-09T08:38:17.771 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../015-python3-rgw_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:17.809 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rgw (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:17.869 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cryptography. 2021-03-09T08:38:17.880 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../025-python3-cryptography_2.1.4-1ubuntu1.4_amd64.deb ... 2021-03-09T08:38:17.919 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-03-09T08:38:18.128 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-03-09T08:38:18.140 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../016-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-03-09T08:38:18.178 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-03-09T08:38:18.314 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-openssl. 2021-03-09T08:38:18.326 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../026-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2021-03-09T08:38:18.364 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2021-03-09T08:38:18.480 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-03-09T08:38:18.492 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../017-libleveldb1v5_1.20-2_amd64.deb ... 2021-03-09T08:38:18.530 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-03-09T08:38:18.625 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-03-09T08:38:18.636 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../027-ceph-mgr-modules-core_17.0.0-1742-g89fb622b-1bionic_all.deb ... 2021-03-09T08:38:18.675 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-modules-core (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:18.883 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liboath0. 2021-03-09T08:38:18.895 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../018-liboath0_2.6.1-1_amd64.deb ... 2021-03-09T08:38:18.925 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-03-09T08:38:19.037 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-bcrypt. 2021-03-09T08:38:19.048 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../028-python3-bcrypt_3.1.4-2_amd64.deb ... 2021-03-09T08:38:19.087 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2021-03-09T08:38:19.235 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libradosstriper1. 2021-03-09T08:38:19.247 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../019-libradosstriper1_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:19.285 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libradosstriper1 (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:19.390 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cherrypy3. 2021-03-09T08:38:19.402 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../029-python3-cherrypy3_8.9.1-2_all.deb ... 2021-03-09T08:38:19.440 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2021-03-09T08:38:19.752 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jwt. 2021-03-09T08:38:19.918 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../030-python3-jwt_1.5.3+ds1-1_all.deb ... 2021-03-09T08:38:19.918 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2021-03-09T08:38:19.918 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-common. 2021-03-09T08:38:19.919 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../020-ceph-common_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:19.919 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-common (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:20.106 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-logutils. 2021-03-09T08:38:20.117 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../031-python3-logutils_0.3.3-5_all.deb ... 2021-03-09T08:38:20.154 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-logutils (0.3.3-5) ... 2021-03-09T08:38:20.473 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-markupsafe. 2021-03-09T08:38:20.484 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../032-python3-markupsafe_1.0-1build1_amd64.deb ... 2021-03-09T08:38:20.523 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2021-03-09T08:38:20.801 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-mako. 2021-03-09T08:38:20.812 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../033-python3-mako_1.0.7+ds1-1_all.deb ... 2021-03-09T08:38:20.851 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2021-03-09T08:38:21.170 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-simplegeneric. 2021-03-09T08:38:21.182 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../034-python3-simplegeneric_0.8.1-1_all.deb ... 2021-03-09T08:38:21.220 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2021-03-09T08:38:21.523 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-singledispatch. 2021-03-09T08:38:21.535 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../035-python3-singledispatch_3.4.0.3-2_all.deb ... 2021-03-09T08:38:21.573 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2021-03-09T08:38:21.627 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-base. 2021-03-09T08:38:21.639 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../021-ceph-base_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:21.686 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-base (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:21.859 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-webob. 2021-03-09T08:38:21.872 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../036-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-03-09T08:38:21.909 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2021-03-09T08:38:22.228 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-bs4. 2021-03-09T08:38:22.242 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../037-python3-bs4_4.6.0-1_all.deb ... 2021-03-09T08:38:22.295 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2021-03-09T08:38:22.590 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-dateutil. 2021-03-09T08:38:22.602 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../022-python3-dateutil_2.6.1-1_all.deb ... 2021-03-09T08:38:22.639 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-waitress. 2021-03-09T08:38:22.640 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2021-03-09T08:38:22.651 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../038-python3-waitress_1.0.1-1_all.deb ... 2021-03-09T08:38:22.689 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-waitress (1.0.1-1) ... 2021-03-09T08:38:22.967 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-asn1crypto. 2021-03-09T08:38:22.979 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../023-python3-asn1crypto_0.24.0-1_all.deb ... 2021-03-09T08:38:22.991 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-tempita. 2021-03-09T08:38:23.004 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-2_all.deb ... 2021-03-09T08:38:23.017 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2021-03-09T08:38:23.042 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-tempita (0.5.2-2) ... 2021-03-09T08:38:23.295 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cffi-backend. 2021-03-09T08:38:23.306 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../024-python3-cffi-backend_1.11.5-1_amd64.deb ... 2021-03-09T08:38:23.328 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-paste. 2021-03-09T08:38:23.341 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../040-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-03-09T08:38:23.344 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2021-03-09T08:38:23.377 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-03-09T08:38:23.631 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cryptography. 2021-03-09T08:38:23.643 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../025-python3-cryptography_2.1.4-1ubuntu1.4_amd64.deb ... 2021-03-09T08:38:23.647 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-03-09T08:38:23.659 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-03-09T08:38:23.681 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-03-09T08:38:23.688 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-03-09T08:38:23.992 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-openssl. 2021-03-09T08:38:23.999 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pastedeploy. 2021-03-09T08:38:24.005 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../026-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2021-03-09T08:38:24.012 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../042-python3-pastedeploy_1.5.2-4_all.deb ... 2021-03-09T08:38:24.042 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2021-03-09T08:38:24.050 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2021-03-09T08:38:24.311 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-03-09T08:38:24.323 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../027-ceph-mgr-modules-core_17.0.0-1742-g89fb622b-1bionic_all.deb ... 2021-03-09T08:38:24.362 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-modules-core (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:24.369 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-webtest. 2021-03-09T08:38:24.382 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../043-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2021-03-09T08:38:24.419 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2021-03-09T08:38:24.699 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-bcrypt. 2021-03-09T08:38:24.717 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../028-python3-bcrypt_3.1.4-2_amd64.deb ... 2021-03-09T08:38:24.741 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2021-03-09T08:38:24.746 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pecan. 2021-03-09T08:38:24.759 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../044-python3-pecan_1.2.1-2_all.deb ... 2021-03-09T08:38:24.797 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pecan (1.2.1-2) ... 2021-03-09T08:38:25.035 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cherrypy3. 2021-03-09T08:38:25.048 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../029-python3-cherrypy3_8.9.1-2_all.deb ... 2021-03-09T08:38:25.085 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2021-03-09T08:38:25.143 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-werkzeug. 2021-03-09T08:38:25.155 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../045-python3-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-03-09T08:38:25.193 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-03-09T08:38:25.396 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jwt. 2021-03-09T08:38:25.408 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../030-python3-jwt_1.5.3+ds1-1_all.deb ... 2021-03-09T08:38:25.447 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2021-03-09T08:38:25.571 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr. 2021-03-09T08:38:25.582 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../046-ceph-mgr_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:25.621 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:25.766 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-logutils. 2021-03-09T08:38:25.779 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../031-python3-logutils_0.3.3-5_all.deb ... 2021-03-09T08:38:25.816 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-logutils (0.3.3-5) ... 2021-03-09T08:38:26.041 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mon. 2021-03-09T08:38:26.053 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../047-ceph-mon_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:26.091 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mon (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:26.101 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-markupsafe. 2021-03-09T08:38:26.114 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../032-python3-markupsafe_1.0-1build1_amd64.deb ... 2021-03-09T08:38:26.152 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2021-03-09T08:38:26.446 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-mako. 2021-03-09T08:38:26.457 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../033-python3-mako_1.0.7+ds1-1_all.deb ... 2021-03-09T08:38:26.504 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2021-03-09T08:38:26.807 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplegeneric. 2021-03-09T08:38:26.819 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../034-python3-simplegeneric_0.8.1-1_all.deb ... 2021-03-09T08:38:26.848 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2021-03-09T08:38:27.036 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-osd. 2021-03-09T08:38:27.048 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../048-ceph-osd_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:27.085 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-osd (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:27.143 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-singledispatch. 2021-03-09T08:38:27.154 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../035-python3-singledispatch_3.4.0.3-2_all.deb ... 2021-03-09T08:38:27.193 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2021-03-09T08:38:27.495 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webob. 2021-03-09T08:38:27.506 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../036-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-03-09T08:38:27.545 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2021-03-09T08:38:27.864 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-bs4. 2021-03-09T08:38:27.876 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../037-python3-bs4_4.6.0-1_all.deb ... 2021-03-09T08:38:27.914 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2021-03-09T08:38:28.225 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-waitress. 2021-03-09T08:38:28.238 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../038-python3-waitress_1.0.1-1_all.deb ... 2021-03-09T08:38:28.275 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-waitress (1.0.1-1) ... 2021-03-09T08:38:28.603 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tempita. 2021-03-09T08:38:28.615 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-2_all.deb ... 2021-03-09T08:38:28.653 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tempita (0.5.2-2) ... 2021-03-09T08:38:28.946 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-paste. 2021-03-09T08:38:28.959 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../040-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-03-09T08:38:28.988 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-03-09T08:38:29.065 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph. 2021-03-09T08:38:29.078 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../049-ceph_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:29.107 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:29.300 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-03-09T08:38:29.312 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-03-09T08:38:29.350 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-03-09T08:38:29.428 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-fuse. 2021-03-09T08:38:29.441 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../050-ceph-fuse_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:29.477 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-fuse (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:29.652 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastedeploy. 2021-03-09T08:38:29.664 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../042-python3-pastedeploy_1.5.2-4_all.deb ... 2021-03-09T08:38:29.702 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2021-03-09T08:38:29.898 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mds. 2021-03-09T08:38:29.909 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../051-ceph-mds_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:29.947 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mds (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:29.971 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webtest. 2021-03-09T08:38:29.983 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../043-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2021-03-09T08:38:30.021 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2021-03-09T08:38:30.359 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pecan. 2021-03-09T08:38:30.370 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../044-python3-pecan_1.2.1-2_all.deb ... 2021-03-09T08:38:30.407 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pecan (1.2.1-2) ... 2021-03-09T08:38:30.425 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package cephadm. 2021-03-09T08:38:30.436 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../052-cephadm_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:30.475 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking cephadm (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:31.525 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-werkzeug. 2021-03-09T08:38:31.538 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../045-python3-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-03-09T08:38:31.578 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-03-09T08:38:31.662 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jinja2. 2021-03-09T08:38:31.674 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../053-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2021-03-09T08:38:31.712 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-03-09T08:38:31.920 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr. 2021-03-09T08:38:31.930 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../046-ceph-mgr_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:31.961 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:32.039 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-03-09T08:38:32.051 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../054-ceph-mgr-cephadm_17.0.0-1742-g89fb622b-1bionic_all.deb ... 2021-03-09T08:38:32.089 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-cephadm (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:32.415 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mon. 2021-03-09T08:38:32.417 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-repoze.lru. 2021-03-09T08:38:32.430 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../047-ceph-mon_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:32.431 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../055-python3-repoze.lru_0.7-1_all.deb ... 2021-03-09T08:38:32.464 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mon (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:32.467 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2021-03-09T08:38:32.770 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-routes. 2021-03-09T08:38:32.783 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../056-python3-routes_2.4.1-1_all.deb ... 2021-03-09T08:38:32.811 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-routes (2.4.1-1) ... 2021-03-09T08:38:33.121 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-03-09T08:38:33.133 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_17.0.0-1742-g89fb622b-1bionic_all.deb ... 2021-03-09T08:38:33.162 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-dashboard (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:33.393 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-osd. 2021-03-09T08:38:33.406 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../048-ceph-osd_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:33.443 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-osd (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:34.066 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-numpy. 2021-03-09T08:38:34.079 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../058-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2021-03-09T08:38:34.116 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2021-03-09T08:38:34.747 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-decorator. 2021-03-09T08:38:34.759 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../059-python3-decorator_4.1.2-1_all.deb ... 2021-03-09T08:38:34.797 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-decorator (4.1.2-1) ... 2021-03-09T08:38:35.108 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-scipy. 2021-03-09T08:38:35.120 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../060-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-03-09T08:38:35.157 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2021-03-09T08:38:35.481 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph. 2021-03-09T08:38:35.492 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../049-ceph_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:35.531 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:35.834 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-fuse. 2021-03-09T08:38:35.846 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../050-ceph-fuse_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:35.883 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-fuse (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:36.269 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mds. 2021-03-09T08:38:36.280 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../051-ceph-mds_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:36.311 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mds (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:36.366 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-03-09T08:38:36.379 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../061-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2021-03-09T08:38:36.416 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2021-03-09T08:38:36.814 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephadm. 2021-03-09T08:38:36.825 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../052-cephadm_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:36.839 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-joblib. 2021-03-09T08:38:36.852 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../062-python3-joblib_0.11-1_all.deb ... 2021-03-09T08:38:36.864 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephadm (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:36.889 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-joblib (0.11-1) ... 2021-03-09T08:38:37.183 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jinja2. 2021-03-09T08:38:37.195 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../053-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2021-03-09T08:38:37.233 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-03-09T08:38:37.234 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-sklearn. 2021-03-09T08:38:37.246 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../063-python3-sklearn_0.19.1-3_all.deb ... 2021-03-09T08:38:37.284 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2021-03-09T08:38:37.552 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-03-09T08:38:37.565 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../054-ceph-mgr-cephadm_17.0.0-1742-g89fb622b-1bionic_all.deb ... 2021-03-09T08:38:37.602 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-cephadm (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:37.773 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-03-09T08:38:37.786 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../064-ceph-mgr-diskprediction-local_17.0.0-1742-g89fb622b-1bionic_all.deb ... 2021-03-09T08:38:37.823 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-diskprediction-local (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:37.889 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-repoze.lru. 2021-03-09T08:38:37.902 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../055-python3-repoze.lru_0.7-1_all.deb ... 2021-03-09T08:38:37.930 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2021-03-09T08:38:38.217 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-routes. 2021-03-09T08:38:38.230 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../056-python3-routes_2.4.1-1_all.deb ... 2021-03-09T08:38:38.267 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-routes (2.4.1-1) ... 2021-03-09T08:38:38.577 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-03-09T08:38:38.589 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_17.0.0-1742-g89fb622b-1bionic_all.deb ... 2021-03-09T08:38:38.627 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-dashboard (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:38.935 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-monotonic. 2021-03-09T08:38:38.948 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../065-python3-monotonic_1.1-2_all.deb ... 2021-03-09T08:38:38.993 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-monotonic (1.1-2) ... 2021-03-09T08:38:39.287 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-fasteners. 2021-03-09T08:38:39.299 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../066-python3-fasteners_0.12.0-3_all.deb ... 2021-03-09T08:38:39.329 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2021-03-09T08:38:39.507 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-numpy. 2021-03-09T08:38:39.520 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../058-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2021-03-09T08:38:39.557 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2021-03-09T08:38:39.607 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-httplib2. 2021-03-09T08:38:39.620 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../067-python3-httplib2_0.9.2+dfsg-1ubuntu0.3_all.deb ... 2021-03-09T08:38:39.656 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-03-09T08:38:39.951 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pyasn1. 2021-03-09T08:38:39.964 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../068-python3-pyasn1_0.4.2-3_all.deb ... 2021-03-09T08:38:40.001 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2021-03-09T08:38:40.180 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-decorator. 2021-03-09T08:38:40.191 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../059-python3-decorator_4.1.2-1_all.deb ... 2021-03-09T08:38:40.221 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-decorator (4.1.2-1) ... 2021-03-09T08:38:40.346 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-03-09T08:38:40.358 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../069-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-03-09T08:38:40.396 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2021-03-09T08:38:40.516 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-scipy. 2021-03-09T08:38:40.528 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../060-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-03-09T08:38:40.566 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2021-03-09T08:38:40.732 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-rsa. 2021-03-09T08:38:40.744 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../070-python3-rsa_3.4.2-1_all.deb ... 2021-03-09T08:38:40.782 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-rsa (3.4.2-1) ... 2021-03-09T08:38:41.102 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-sqlalchemy. 2021-03-09T08:38:41.115 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../071-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-03-09T08:38:41.144 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-03-09T08:38:41.548 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-oauth2client. 2021-03-09T08:38:41.560 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../072-python3-oauth2client_4.1.2-3_all.deb ... 2021-03-09T08:38:41.598 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2021-03-09T08:38:41.882 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-03-09T08:38:41.895 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../061-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2021-03-09T08:38:41.924 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2021-03-09T08:38:41.925 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-setuptools. 2021-03-09T08:38:41.937 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../073-python3-setuptools_39.0.1-2_all.deb ... 2021-03-09T08:38:41.976 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2021-03-09T08:38:42.352 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-joblib. 2021-03-09T08:38:42.366 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../062-python3-joblib_0.11-1_all.deb ... 2021-03-09T08:38:42.370 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-websocket. 2021-03-09T08:38:42.381 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../074-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2021-03-09T08:38:42.411 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-joblib (0.11-1) ... 2021-03-09T08:38:42.420 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2021-03-09T08:38:42.722 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn. 2021-03-09T08:38:42.734 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../063-python3-sklearn_0.19.1-3_all.deb ... 2021-03-09T08:38:42.748 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-kubernetes. 2021-03-09T08:38:42.760 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../075-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-03-09T08:38:42.773 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2021-03-09T08:38:42.799 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2021-03-09T08:38:43.203 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-03-09T08:38:43.216 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_17.0.0-1742-g89fb622b-1bionic_all.deb ... 2021-03-09T08:38:43.253 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-k8sevents (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:43.264 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-03-09T08:38:43.277 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../064-ceph-mgr-diskprediction-local_17.0.0-1742-g89fb622b-1bionic_all.deb ... 2021-03-09T08:38:43.339 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-diskprediction-local (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:43.572 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-json-pointer. 2021-03-09T08:38:43.584 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../077-python3-json-pointer_1.10-1_all.deb ... 2021-03-09T08:38:43.622 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-json-pointer (1.10-1) ... 2021-03-09T08:38:43.975 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jsonpatch. 2021-03-09T08:38:43.986 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../078-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2021-03-09T08:38:44.027 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-03-09T08:38:44.328 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-03-09T08:38:44.339 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../079-ceph-mgr-rook_17.0.0-1742-g89fb622b-1bionic_all.deb ... 2021-03-09T08:38:44.378 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-rook (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:44.417 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-monotonic. 2021-03-09T08:38:44.428 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../065-python3-monotonic_1.1-2_all.deb ... 2021-03-09T08:38:44.467 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-monotonic (1.1-2) ... 2021-03-09T08:38:44.706 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libonig4:amd64. 2021-03-09T08:38:44.719 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../080-libonig4_6.7.0-1_amd64.deb ... 2021-03-09T08:38:44.736 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-fasteners. 2021-03-09T08:38:44.750 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../066-python3-fasteners_0.12.0-3_all.deb ... 2021-03-09T08:38:44.795 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2021-03-09T08:38:44.841 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-03-09T08:38:45.097 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-httplib2. 2021-03-09T08:38:45.111 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../067-python3-httplib2_0.9.2+dfsg-1ubuntu0.3_all.deb ... 2021-03-09T08:38:45.147 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-03-09T08:38:45.194 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libjq1:amd64. 2021-03-09T08:38:45.207 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../081-libjq1_1.5+dfsg-2_amd64.deb ... 2021-03-09T08:38:45.244 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-03-09T08:38:45.450 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1. 2021-03-09T08:38:45.463 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../068-python3-pyasn1_0.4.2-3_all.deb ... 2021-03-09T08:38:45.488 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package jq. 2021-03-09T08:38:45.500 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2021-03-09T08:38:45.501 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../082-jq_1.5+dfsg-2_amd64.deb ... 2021-03-09T08:38:45.530 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-03-09T08:38:45.757 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package socat. 2021-03-09T08:38:45.771 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../083-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-03-09T08:38:45.815 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-03-09T08:38:45.887 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-03-09T08:38:45.900 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../069-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-03-09T08:38:45.937 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2021-03-09T08:38:46.211 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-03-09T08:38:46.223 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../084-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-03-09T08:38:46.257 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rsa. 2021-03-09T08:38:46.261 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-03-09T08:38:46.269 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../070-python3-rsa_3.4.2-1_all.deb ... 2021-03-09T08:38:46.306 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rsa (3.4.2-1) ... 2021-03-09T08:38:46.538 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package xmlstarlet. 2021-03-09T08:38:46.550 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2_amd64.deb ... 2021-03-09T08:38:46.588 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-03-09T08:38:46.618 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sqlalchemy. 2021-03-09T08:38:46.631 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../071-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-03-09T08:38:46.668 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-03-09T08:38:46.951 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-test. 2021-03-09T08:38:46.963 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../086-ceph-test_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:47.001 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-test (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:47.092 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-oauth2client. 2021-03-09T08:38:47.103 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../072-python3-oauth2client_4.1.2-3_all.deb ... 2021-03-09T08:38:47.147 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2021-03-09T08:38:47.475 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-setuptools. 2021-03-09T08:38:48.342 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../073-python3-setuptools_39.0.1-2_all.deb ... 2021-03-09T08:38:48.343 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2021-03-09T08:38:48.343 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-websocket. 2021-03-09T08:38:48.343 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../074-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2021-03-09T08:38:48.343 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2021-03-09T08:38:48.344 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-kubernetes. 2021-03-09T08:38:48.344 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../075-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-03-09T08:38:48.344 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2021-03-09T08:38:48.735 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-03-09T08:38:48.748 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_17.0.0-1742-g89fb622b-1bionic_all.deb ... 2021-03-09T08:38:48.785 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-k8sevents (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:49.088 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-json-pointer. 2021-03-09T08:38:49.101 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../077-python3-json-pointer_1.10-1_all.deb ... 2021-03-09T08:38:49.138 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-json-pointer (1.10-1) ... 2021-03-09T08:38:49.516 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jsonpatch. 2021-03-09T08:38:49.531 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../078-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2021-03-09T08:38:49.578 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-03-09T08:38:49.861 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-03-09T08:38:49.872 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../079-ceph-mgr-rook_17.0.0-1742-g89fb622b-1bionic_all.deb ... 2021-03-09T08:38:49.921 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-rook (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:50.205 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libonig4:amd64. 2021-03-09T08:38:50.219 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../080-libonig4_6.7.0-1_amd64.deb ... 2021-03-09T08:38:50.341 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-03-09T08:38:50.371 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libcephfs-dev. 2021-03-09T08:38:50.383 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../087-libcephfs-dev_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:50.412 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libcephfs-dev (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:50.710 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjq1:amd64. 2021-03-09T08:38:50.715 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package nvme-cli. 2021-03-09T08:38:50.723 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../081-libjq1_1.5+dfsg-2_amd64.deb ... 2021-03-09T08:38:50.727 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../088-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-03-09T08:38:50.760 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-03-09T08:38:50.765 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-03-09T08:38:51.112 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python-attr. 2021-03-09T08:38:51.122 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package jq. 2021-03-09T08:38:51.123 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../089-python-attr_17.4.0-2_all.deb ... 2021-03-09T08:38:51.135 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../082-jq_1.5+dfsg-2_amd64.deb ... 2021-03-09T08:38:51.161 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python-attr (17.4.0-2) ... 2021-03-09T08:38:51.163 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-03-09T08:38:51.416 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package socat. 2021-03-09T08:38:51.428 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../083-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-03-09T08:38:51.430 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python-funcsigs. 2021-03-09T08:38:51.443 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../090-python-funcsigs_1.0.2-4_all.deb ... 2021-03-09T08:38:51.466 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-03-09T08:38:51.472 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-03-09T08:38:51.716 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python-pluggy. 2021-03-09T08:38:51.729 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../091-python-pluggy_0.6.0-1_all.deb ... 2021-03-09T08:38:51.766 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-03-09T08:38:51.836 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-03-09T08:38:51.849 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../084-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-03-09T08:38:51.886 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-03-09T08:38:52.069 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python-py. 2021-03-09T08:38:52.082 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../092-python-py_1.5.2-1_all.deb ... 2021-03-09T08:38:52.121 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python-py (1.5.2-1) ... 2021-03-09T08:38:52.139 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package xmlstarlet. 2021-03-09T08:38:52.150 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2_amd64.deb ... 2021-03-09T08:38:52.189 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-03-09T08:38:52.430 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python-pytest. 2021-03-09T08:38:52.444 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../093-python-pytest_3.3.2-2_all.deb ... 2021-03-09T08:38:52.489 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-03-09T08:38:52.518 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-test. 2021-03-09T08:38:52.530 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../086-ceph-test_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:52.568 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-test (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:52.817 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-attr. 2021-03-09T08:38:52.831 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../094-python3-attr_17.4.0-2_all.deb ... 2021-03-09T08:38:52.867 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-attr (17.4.0-2) ... 2021-03-09T08:38:53.103 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cycler. 2021-03-09T08:38:53.115 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../095-python3-cycler_0.10.0-1_all.deb ... 2021-03-09T08:38:53.145 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cycler (0.10.0-1) ... 2021-03-09T08:38:53.431 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-webencodings. 2021-03-09T08:38:53.444 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../096-python3-webencodings_0.5-2_all.deb ... 2021-03-09T08:38:53.481 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-webencodings (0.5-2) ... 2021-03-09T08:38:53.783 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-html5lib. 2021-03-09T08:38:53.795 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../097-python3-html5lib_0.999999999-1_all.deb ... 2021-03-09T08:38:53.833 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2021-03-09T08:38:54.136 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-03-09T08:38:54.150 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../098-python3-lxml_4.2.1-1ubuntu0.3_amd64.deb ... 2021-03-09T08:38:54.186 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-03-09T08:38:54.598 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pyparsing. 2021-03-09T08:38:54.612 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../099-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-03-09T08:38:54.656 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-03-09T08:38:55.009 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-tz. 2021-03-09T08:38:55.021 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../100-python3-tz_2018.3-2_all.deb ... 2021-03-09T08:38:55.051 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-tz (2018.3-2) ... 2021-03-09T08:38:55.345 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-matplotlib. 2021-03-09T08:38:55.358 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../101-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2021-03-09T08:38:55.395 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2021-03-09T08:38:55.913 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs-dev. 2021-03-09T08:38:55.926 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../087-libcephfs-dev_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:55.955 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs-dev (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:56.050 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-olefile. 2021-03-09T08:38:56.063 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../102-python3-olefile_0.45.1-1_all.deb ... 2021-03-09T08:38:56.109 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-olefile (0.45.1-1) ... 2021-03-09T08:38:56.232 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package nvme-cli. 2021-03-09T08:38:56.246 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../088-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-03-09T08:38:56.299 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-03-09T08:38:56.378 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pastescript. 2021-03-09T08:38:56.391 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-2_all.deb ... 2021-03-09T08:38:56.420 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2021-03-09T08:38:56.662 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-attr. 2021-03-09T08:38:56.675 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../089-python-attr_17.4.0-2_all.deb ... 2021-03-09T08:38:56.712 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-attr (17.4.0-2) ... 2021-03-09T08:38:56.882 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pil:amd64. 2021-03-09T08:38:56.895 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../104-python3-pil_5.1.0-1ubuntu0.4_amd64.deb ... 2021-03-09T08:38:56.931 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.4) ... 2021-03-09T08:38:56.969 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-funcsigs. 2021-03-09T08:38:56.978 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../090-python-funcsigs_1.0.2-4_all.deb ... 2021-03-09T08:38:57.007 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-03-09T08:38:57.267 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-pluggy. 2021-03-09T08:38:57.281 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../091-python-pluggy_0.6.0-1_all.deb ... 2021-03-09T08:38:57.301 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pluggy. 2021-03-09T08:38:57.314 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../105-python3-pluggy_0.6.0-1_all.deb ... 2021-03-09T08:38:57.325 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-03-09T08:38:57.343 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2021-03-09T08:38:57.604 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-py. 2021-03-09T08:38:57.618 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../092-python-py_1.5.2-1_all.deb ... 2021-03-09T08:38:57.637 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-py. 2021-03-09T08:38:57.650 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../106-python3-py_1.5.2-1_all.deb ... 2021-03-09T08:38:57.662 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-py (1.5.2-1) ... 2021-03-09T08:38:57.687 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-py (1.5.2-1) ... 2021-03-09T08:38:57.990 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-pytest. 2021-03-09T08:38:57.991 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pyinotify. 2021-03-09T08:38:58.002 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../093-python-pytest_3.3.2-2_all.deb ... 2021-03-09T08:38:58.004 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1_all.deb ... 2021-03-09T08:38:58.040 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-03-09T08:38:58.048 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2021-03-09T08:38:58.360 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pytest. 2021-03-09T08:38:59.534 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../108-python3-pytest_3.3.2-2_all.deb ... 2021-03-09T08:38:59.535 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pytest (3.3.2-2) ... 2021-03-09T08:38:59.535 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-simplejson. 2021-03-09T08:38:59.535 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../109-python3-simplejson_3.13.2-1_amd64.deb ... 2021-03-09T08:38:59.536 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2021-03-09T08:38:59.536 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-tk:amd64. 2021-03-09T08:38:59.537 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../110-python3-tk_3.6.9-1~18.04_amd64.deb ... 2021-03-09T08:38:59.537 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2021-03-09T08:38:59.538 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-attr. 2021-03-09T08:38:59.538 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../094-python3-attr_17.4.0-2_all.deb ... 2021-03-09T08:38:59.539 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-attr (17.4.0-2) ... 2021-03-09T08:38:59.539 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cycler. 2021-03-09T08:38:59.539 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../095-python3-cycler_0.10.0-1_all.deb ... 2021-03-09T08:38:59.540 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cycler (0.10.0-1) ... 2021-03-09T08:38:59.540 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webencodings. 2021-03-09T08:38:59.540 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../096-python3-webencodings_0.5-2_all.deb ... 2021-03-09T08:38:59.541 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webencodings (0.5-2) ... 2021-03-09T08:38:59.541 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-html5lib. 2021-03-09T08:38:59.541 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../097-python3-html5lib_0.999999999-1_all.deb ... 2021-03-09T08:38:59.542 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2021-03-09T08:38:59.587 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package radosgw. 2021-03-09T08:38:59.600 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../111-radosgw_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:38:59.636 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking radosgw (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:38:59.763 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-03-09T08:38:59.776 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../098-python3-lxml_4.2.1-1ubuntu0.3_amd64.deb ... 2021-03-09T08:38:59.813 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-03-09T08:39:00.266 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyparsing. 2021-03-09T08:39:00.280 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../099-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-03-09T08:39:00.324 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-03-09T08:39:00.619 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tz. 2021-03-09T08:39:00.633 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../100-python3-tz_2018.3-2_all.deb ... 2021-03-09T08:39:00.656 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package rbd-fuse. 2021-03-09T08:39:00.669 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tz (2018.3-2) ... 2021-03-09T08:39:00.669 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../112-rbd-fuse_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:39:00.706 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking rbd-fuse (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:00.980 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-matplotlib. 2021-03-09T08:39:00.992 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../101-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2021-03-09T08:39:01.021 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-logutils (0.3.3-5) ... 2021-03-09T08:39:01.030 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2021-03-09T08:39:01.336 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-03-09T08:39:01.669 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-olefile. 2021-03-09T08:39:01.682 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../102-python3-olefile_0.45.1-1_all.deb ... 2021-03-09T08:39:01.696 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2021-03-09T08:39:01.727 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-olefile (0.45.1-1) ... 2021-03-09T08:39:02.039 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastescript. 2021-03-09T08:39:02.052 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-2_all.deb ... 2021-03-09T08:39:02.089 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2021-03-09T08:39:02.105 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-03-09T08:39:02.459 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pil:amd64. 2021-03-09T08:39:02.472 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../104-python3-pil_5.1.0-1ubuntu0.4_amd64.deb ... 2021-03-09T08:39:02.509 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.4) ... 2021-03-09T08:39:02.707 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.4) ... 2021-03-09T08:39:02.870 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pluggy. 2021-03-09T08:39:02.884 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../105-python3-pluggy_0.6.0-1_all.deb ... 2021-03-09T08:39:02.937 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2021-03-09T08:39:03.092 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2021-03-09T08:39:03.240 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-py. 2021-03-09T08:39:03.252 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../106-python3-py_1.5.2-1_all.deb ... 2021-03-09T08:39:03.289 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-py (1.5.2-1) ... 2021-03-09T08:39:03.351 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-webencodings (0.5-2) ... 2021-03-09T08:39:03.609 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyinotify. 2021-03-09T08:39:03.619 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python-attr (17.4.0-2) ... 2021-03-09T08:39:03.621 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1_all.deb ... 2021-03-09T08:39:03.659 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2021-03-09T08:39:03.820 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2021-03-09T08:39:03.946 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-py (1.5.2-1) ... 2021-03-09T08:39:03.962 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pytest. 2021-03-09T08:39:03.975 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../108-python3-pytest_3.3.2-2_all.deb ... 2021-03-09T08:39:04.012 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pytest (3.3.2-2) ... 2021-03-09T08:39:04.289 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-waitress (1.0.1-1) ... 2021-03-09T08:39:04.316 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplejson. 2021-03-09T08:39:04.330 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../109-python3-simplejson_3.13.2-1_amd64.deb ... 2021-03-09T08:39:04.374 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2021-03-09T08:39:04.646 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-03-09T08:39:04.694 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tk:amd64. 2021-03-09T08:39:04.707 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../110-python3-tk_3.6.9-1~18.04_amd64.deb ... 2021-03-09T08:39:04.743 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2021-03-09T08:39:04.959 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-olefile (0.45.1-1) ... 2021-03-09T08:39:05.189 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package radosgw. 2021-03-09T08:39:05.201 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../111-radosgw_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:39:05.239 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking radosgw (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:05.253 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-ceph-argparse (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:05.537 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-tempita (0.5.2-2) ... 2021-03-09T08:39:05.846 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-03-09T08:39:05.971 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2021-03-09T08:39:06.251 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package rbd-fuse. 2021-03-09T08:39:06.263 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../112-rbd-fuse_17.0.0-1742-g89fb622b-1bionic_amd64.deb ... 2021-03-09T08:39:06.292 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking rbd-fuse (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:06.586 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-logutils (0.3.3-5) ... 2021-03-09T08:39:06.891 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-03-09T08:39:06.916 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2021-03-09T08:39:07.234 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2021-03-09T08:39:07.242 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2021-03-09T08:39:07.351 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-03-09T08:39:07.519 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python-py (1.5.2-1) ... 2021-03-09T08:39:08.020 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.4) ... 2021-03-09T08:39:08.021 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-simplejson (3.13.2-1) ... 2021-03-09T08:39:08.063 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-json-pointer (1.10-1) ... 2021-03-09T08:39:08.151 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2021-03-09T08:39:08.322 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2021-03-09T08:39:08.381 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-03-09T08:39:08.506 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-03-09T08:39:08.615 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webencodings (0.5-2) ... 2021-03-09T08:39:08.708 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2021-03-09T08:39:08.908 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-attr (17.4.0-2) ... 2021-03-09T08:39:09.009 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-03-09T08:39:09.092 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2021-03-09T08:39:09.201 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-py (1.5.2-1) ... 2021-03-09T08:39:09.318 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cycler (0.10.0-1) ... 2021-03-09T08:39:09.528 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-waitress (1.0.1-1) ... 2021-03-09T08:39:09.578 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2021-03-09T08:39:09.925 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-03-09T08:39:09.929 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-bs4 (4.6.0-1) ... 2021-03-09T08:39:10.231 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-olefile (0.45.1-1) ... 2021-03-09T08:39:10.264 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pluggy (0.6.0-1) ... 2021-03-09T08:39:10.540 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-argparse (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:10.556 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up cephadm (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:10.850 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tempita (0.5.2-2) ... 2021-03-09T08:39:11.151 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-03-09T08:39:11.249 INFO:teuthology.orchestra.run.smithi091.stdout:Adding system user cephadm....done 2021-03-09T08:39:11.260 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2021-03-09T08:39:11.404 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2021-03-09T08:39:11.705 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-03-09T08:39:11.831 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-03-09T08:39:11.991 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2021-03-09T08:39:12.196 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2021-03-09T08:39:12.327 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-prettytable (0.7.2-3) ... 2021-03-09T08:39:12.506 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2021-03-09T08:39:12.620 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-03-09T08:39:12.746 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2021-03-09T08:39:12.799 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-py (1.5.2-1) ... 2021-03-09T08:39:13.025 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplejson (3.13.2-1) ... 2021-03-09T08:39:13.089 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-ceph-common (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:13.343 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-json-pointer (1.10-1) ... 2021-03-09T08:39:13.407 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-monotonic (1.1-2) ... 2021-03-09T08:39:13.424 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2021-03-09T08:39:13.686 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-03-09T08:39:13.708 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-03-09T08:39:13.812 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-03-09T08:39:13.834 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-03-09T08:39:14.071 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2021-03-09T08:39:14.177 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-html5lib (0.999999999-1) ... 2021-03-09T08:39:14.381 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-03-09T08:39:14.528 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-03-09T08:39:14.618 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-03-09T08:39:14.650 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2021-03-09T08:39:14.707 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cycler (0.10.0-1) ... 2021-03-09T08:39:14.880 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-repoze.lru (0.7-1) ... 2021-03-09T08:39:14.999 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2021-03-09T08:39:15.206 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-03-09T08:39:15.359 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-bs4 (4.6.0-1) ... 2021-03-09T08:39:15.515 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2021-03-09T08:39:15.677 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pluggy (0.6.0-1) ... 2021-03-09T08:39:15.867 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-attr (17.4.0-2) ... 2021-03-09T08:39:15.970 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephadm (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:16.193 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-03-09T08:39:16.386 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libjaeger (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:16.495 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-03-09T08:39:16.896 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2021-03-09T08:39:16.980 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user cephadm....done 2021-03-09T08:39:17.011 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-03-09T08:39:17.128 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2021-03-09T08:39:17.273 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up liboath0 (2.6.1-1) ... 2021-03-09T08:39:17.468 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-03-09T08:39:17.469 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-03-09T08:39:17.537 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-03-09T08:39:17.575 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2021-03-09T08:39:17.672 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2021-03-09T08:39:17.835 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-03-09T08:39:17.944 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-setuptools (39.0.1-2) ... 2021-03-09T08:39:18.023 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-prettytable (0.7.2-3) ... 2021-03-09T08:39:18.312 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-03-09T08:39:18.315 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-03-09T08:39:18.438 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-decorator (4.1.2-1) ... 2021-03-09T08:39:18.441 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2021-03-09T08:39:18.722 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-tz (2018.3-2) ... 2021-03-09T08:39:18.784 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-common (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:19.032 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2021-03-09T08:39:19.077 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-monotonic (1.1-2) ... 2021-03-09T08:39:19.333 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2021-03-09T08:39:19.370 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-03-09T08:39:19.496 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-03-09T08:39:19.651 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-joblib (0.11-1) ... 2021-03-09T08:39:19.847 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-html5lib (0.999999999-1) ... 2021-03-09T08:39:20.019 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-routes (2.4.1-1) ... 2021-03-09T08:39:20.199 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-03-09T08:39:20.288 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-03-09T08:39:20.303 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2021-03-09T08:39:20.321 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2021-03-09T08:39:20.576 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-repoze.lru (0.7-1) ... 2021-03-09T08:39:20.604 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-dateutil (2.6.1-1) ... 2021-03-09T08:39:20.879 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-03-09T08:39:20.922 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-03-09T08:39:21.175 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2021-03-09T08:39:21.317 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-fasteners (0.12.0-3) ... 2021-03-09T08:39:21.505 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-attr (17.4.0-2) ... 2021-03-09T08:39:21.608 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up jq (1.5+dfsg-2) ... 2021-03-09T08:39:21.743 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2021-03-09T08:39:21.805 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-03-09T08:39:21.998 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjaeger (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:22.124 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-03-09T08:39:22.525 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2021-03-09T08:39:22.614 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-03-09T08:39:22.852 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liboath0 (2.6.1-1) ... 2021-03-09T08:39:22.897 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-03-09T08:39:23.011 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-03-09T08:39:23.137 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2021-03-09T08:39:23.223 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2021-03-09T08:39:23.405 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-03-09T08:39:23.540 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-setuptools (39.0.1-2) ... 2021-03-09T08:39:23.558 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2021-03-09T08:39:23.692 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pytest (3.3.2-2) ... 2021-03-09T08:39:23.925 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-03-09T08:39:24.050 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-decorator (4.1.2-1) ... 2021-03-09T08:39:24.069 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python-pytest (3.3.2-2) ... 2021-03-09T08:39:24.303 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-03-09T08:39:24.335 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tz (2018.3-2) ... 2021-03-09T08:39:24.429 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-03-09T08:39:24.555 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librados2 (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:24.619 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2021-03-09T08:39:24.689 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-rsa (3.4.2-1) ... 2021-03-09T08:39:24.920 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2021-03-09T08:39:24.999 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libcephfs2 (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:25.141 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libcephfs-dev (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:25.230 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-joblib (0.11-1) ... 2021-03-09T08:39:25.276 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-rados (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:25.401 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2021-03-09T08:39:25.606 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-routes (2.4.1-1) ... 2021-03-09T08:39:25.719 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2021-03-09T08:39:25.916 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2021-03-09T08:39:26.004 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2021-03-09T08:39:26.217 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-dateutil (2.6.1-1) ... 2021-03-09T08:39:26.415 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2021-03-09T08:39:26.560 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-03-09T08:39:26.920 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-fasteners (0.12.0-3) ... 2021-03-09T08:39:27.213 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up jq (1.5+dfsg-2) ... 2021-03-09T08:39:27.243 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-sklearn (0.19.1-3) ... 2021-03-09T08:39:27.338 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2021-03-09T08:39:28.105 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2021-03-09T08:39:28.398 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libradosstriper1 (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:28.493 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-03-09T08:39:28.524 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cephfs (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:28.650 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librgw2 (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:28.776 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-fuse (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:28.803 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2021-03-09T08:39:28.995 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-03-09T08:39:28.996 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-03-09T08:39:29.129 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2021-03-09T08:39:29.255 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pytest (3.3.2-2) ... 2021-03-09T08:39:29.286 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librbd1 (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:29.404 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pecan (1.2.1-2) ... 2021-03-09T08:39:29.493 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-03-09T08:39:29.534 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-03-09T08:39:29.615 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-pytest (3.3.2-2) ... 2021-03-09T08:39:29.840 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2021-03-09T08:39:29.874 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-03-09T08:39:30.000 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-03-09T08:39:30.126 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librados2 (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:30.244 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rsa (3.4.2-1) ... 2021-03-09T08:39:30.509 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-modules-core (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:30.528 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs2 (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:30.644 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pastescript (2.0.2-2) ... 2021-03-09T08:39:30.654 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs-dev (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:30.780 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rados (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:30.915 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2021-03-09T08:39:30.928 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-rgw (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:31.070 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up rbd-fuse (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:31.197 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-rbd (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:31.224 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2021-03-09T08:39:31.322 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-common (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:31.526 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2021-03-09T08:39:31.865 INFO:teuthology.orchestra.run.smithi091.stdout:Adding group ceph....done 2021-03-09T08:39:31.937 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2021-03-09T08:39:32.234 INFO:teuthology.orchestra.run.smithi091.stdout:Adding system user ceph....done 2021-03-09T08:39:32.604 INFO:teuthology.orchestra.run.smithi091.stdout:Setting system user ceph properties....done 2021-03-09T08:39:32.753 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-03-09T08:39:32.773 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn (0.19.1-3) ... 2021-03-09T08:39:32.978 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-03-09T08:39:33.266 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up radosgw (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:33.532 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-03-09T08:39:33.532 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-03-09T08:39:33.602 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2021-03-09T08:39:33.870 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libradosstriper1 (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:33.918 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-test (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:33.996 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cephfs (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:34.044 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-base (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:34.122 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librgw2 (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:34.248 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-fuse (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:34.343 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-03-09T08:39:34.461 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-03-09T08:39:34.461 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-03-09T08:39:34.620 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:34.741 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librbd1 (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:34.833 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-03-09T08:39:34.834 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-03-09T08:39:34.868 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pecan (1.2.1-2) ... 2021-03-09T08:39:34.957 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-03-09T08:39:34.990 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-03-09T08:39:35.122 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-diskprediction-local (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:35.264 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-osd (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:35.287 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2021-03-09T08:39:35.711 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-03-09T08:39:35.711 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-03-09T08:39:35.940 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-modules-core (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:35.992 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-cephadm (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:36.065 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastescript (2.0.2-2) ... 2021-03-09T08:39:36.134 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-rook (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:36.268 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mds (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:36.408 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rgw (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:36.483 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-03-09T08:39:36.483 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-03-09T08:39:36.534 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up rbd-fuse (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:36.660 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rbd (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:36.753 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mon (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:36.778 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-common (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:36.971 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-03-09T08:39:36.972 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-03-09T08:39:37.246 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-k8sevents (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:37.344 INFO:teuthology.orchestra.run.smithi106.stdout:Adding group ceph....done 2021-03-09T08:39:37.372 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-dashboard (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:37.515 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:37.715 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user ceph....done 2021-03-09T08:39:37.809 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for systemd (237-3ubuntu10.44) ... 2021-03-09T08:39:37.882 INFO:teuthology.orchestra.run.smithi106.stdout:Setting system user ceph properties....done 2021-03-09T08:39:38.001 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-03-09T08:39:38.033 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-03-09T08:39:38.261 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-03-09T08:39:38.538 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up radosgw (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:38.987 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-03-09T08:39:38.987 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-03-09T08:39:39.190 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-test (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:39.316 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-base (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:39.650 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-03-09T08:39:39.943 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:40.146 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-03-09T08:39:40.151 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-03-09T08:39:40.151 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-03-09T08:39:40.188 INFO:teuthology.orchestra.run.smithi091.stdout:ureadahead will be reprofiled on next reboot 2021-03-09T08:39:40.246 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-03-09T08:39:40.427 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-diskprediction-local (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:40.563 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-osd (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:40.685 INFO:teuthology.orchestra.run.smithi091.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-03-09T08:39:40.688 DEBUG:teuthology.parallel:result is None 2021-03-09T08:39:40.984 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-03-09T08:39:40.984 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-03-09T08:39:41.255 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-cephadm (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:41.398 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-rook (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:41.541 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mds (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:41.741 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-03-09T08:39:41.741 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-03-09T08:39:42.009 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mon (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:42.209 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-03-09T08:39:42.210 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-03-09T08:39:42.645 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-k8sevents (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:42.771 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-dashboard (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:42.913 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph (17.0.0-1742-g89fb622b-1bionic) ... 2021-03-09T08:39:43.049 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for systemd (237-3ubuntu10.44) ... 2021-03-09T08:39:43.258 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-03-09T08:39:45.485 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-03-09T08:39:45.519 INFO:teuthology.orchestra.run.smithi106.stdout:ureadahead will be reprofiled on next reboot 2021-03-09T08:39:45.569 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-03-09T08:39:46.010 INFO:teuthology.orchestra.run.smithi106.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-03-09T08:39:46.013 DEBUG:teuthology.parallel:result is None 2021-03-09T08:39:46.013 DEBUG:teuthology.orchestra.run.smithi091:> sudo lsb_release -is 2021-03-09T08:39:46.071 INFO:teuthology.orchestra.run.smithi091.stdout:Ubuntu 2021-03-09T08:39:46.076 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-03-09T08:39:46.077 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=89fb622b10ca2e58fe0c913a8956377a886e2ab4 2021-03-09T08:39:46.234 DEBUG:teuthology.orchestra.run.smithi091:> dpkg-query -W -f '${Version}' ceph 2021-03-09T08:39:46.259 INFO:teuthology.orchestra.run.smithi091.stdout:17.0.0-1742-g89fb622b-1bionic 2021-03-09T08:39:46.260 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-1742-g89fb622b-1bionic 2021-03-09T08:39:46.261 INFO:teuthology.task.install:The correct ceph version 17.0.0-1742-g89fb622b-1bionic is installed. 2021-03-09T08:39:46.261 DEBUG:teuthology.orchestra.run.smithi106:> sudo lsb_release -is 2021-03-09T08:39:46.316 INFO:teuthology.orchestra.run.smithi106.stdout:Ubuntu 2021-03-09T08:39:46.321 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-03-09T08:39:46.322 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=89fb622b10ca2e58fe0c913a8956377a886e2ab4 2021-03-09T08:39:46.472 DEBUG:teuthology.orchestra.run.smithi106:> dpkg-query -W -f '${Version}' ceph 2021-03-09T08:39:46.498 INFO:teuthology.orchestra.run.smithi106.stdout:17.0.0-1742-g89fb622b-1bionic 2021-03-09T08:39:46.499 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-1742-g89fb622b-1bionic 2021-03-09T08:39:46.500 INFO:teuthology.task.install:The correct ceph version 17.0.0-1742-g89fb622b-1bionic is installed. 2021-03-09T08:39:46.500 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-03-09T08:39:46.502 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:39:46.503 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-03-09T08:39:46.519 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:39:46.520 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-03-09T08:39:46.555 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-03-09T08:39:46.558 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:39:46.559 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/daemon-helper 2021-03-09T08:39:46.576 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-03-09T08:39:46.632 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:39:46.633 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2021-03-09T08:39:46.649 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-03-09T08:39:46.706 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-03-09T08:39:46.707 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:39:46.707 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/adjust-ulimits 2021-03-09T08:39:46.722 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-03-09T08:39:46.780 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:39:46.781 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2021-03-09T08:39:46.796 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-03-09T08:39:46.854 INFO:teuthology.run_tasks:Running task ceph... 2021-03-09T08:39:46.961 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-03-09T08:39:46.962 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 777 /var/log/ceph 2021-03-09T08:39:46.965 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /var/log/ceph 2021-03-09T08:39:46.978 INFO:tasks.ceph:Disabling ceph logrotate... 2021-03-09T08:39:46.979 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /etc/logrotate.d/ceph 2021-03-09T08:39:47.019 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/logrotate.d/ceph 2021-03-09T08:39:47.032 INFO:tasks.ceph:Creating extra log directories... 2021-03-09T08:39:47.033 DEBUG:teuthology.orchestra.run.smithi091:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-03-09T08:39:47.075 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-03-09T08:39:47.106 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-03-09T08:39:47.107 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2021-03-09T08:39:47.107 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/kchai-2021-03-09_08:22:40-rados-wip-kefu-testing-2021-03-09-1428-distro-basic-smithi/5949085', 'branch': 'wip-kefu-testing-2021-03-09-1428', 'description': 'rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests}', 'email': 'tchaikov@gmail.com', 'first_in_suite': False, 'job_id': '5949085', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'kchai-2021-03-09_08:22:40-rados-wip-kefu-testing-2021-03-09-1428-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '18.04', 'overrides': {'admin_socket': {'branch': 'wip-kefu-testing-2021-03-09-1428'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'mon_bind_msgr2': False, 'sha1': '89fb622b10ca2e58fe0c913a8956377a886e2ab4'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': '89fb622b10ca2e58fe0c913a8956377a886e2ab4'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-kefu-testing-2021-03-09-1428', 'sha1': '89fb622b10ca2e58fe0c913a8956377a886e2ab4'}}, 'owner': 'scheduled_kchai@teuthology', 'priority': 60, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '89fb622b10ca2e58fe0c913a8956377a886e2ab4', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-kefu-testing-2021-03-09-1428', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_89fb622b10ca2e58fe0c913a8956377a886e2ab4/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': '89fb622b10ca2e58fe0c913a8956377a886e2ab4', 'targets': {'smithi091.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDTnRj1c00cFXME3oKmR/4NlUlhDE19vrst/BO1W3K9mWReAO9tLpiEHFJmm9AsaNMLJ9ia+/VLPKODuNLqAvidPJSjqP3F3lFmVSHEk6t1EPXehVmJDa1QhAl0hPNrbgq6K/uUxvjKsL3/zxsA3d3INg+Bcm9HId8F4/OXk5KxpOOjc1qHYZxbBXGZITRFXMazhFGwlaoctA0x3YwBnb8RlVrMibKkuKpoxPYo7BQDYbtXc2ShwA4id2w3ATQpLEL2Ol7rkqm2R/t7Qxui334aFmfjUKBeP9QP5sx6g/ReKpCaYCCnXyi7SLBozdySMQWmUZReHhu73pd92jipkzFt', 'smithi106.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRTVvrdUpxAVM5gpAfjT8PgDli6RQuKCLH6Z8dyM5lCzWGpd6VkfqMUWMRBencaI90KGFZDDs2JS9K9B942RHo0+KGzNPcjkTPMarjtuZu+KjYYMlgjcP3PnPa7a4G/Kg3v+QfigvvwLGIoTwbD9lRNhkRGAWUUEbTKd03KteyhNY4gOocfNm8cFRPUs9wu6PsQYAtKSyYBvBJM4tKEeaw1LFUE7M3J5aB9K/pEwN92P1ijjgniI7FbHhRJmPx1Urhzr6XJJ6DPLMNnJ7pZh+GDcin7nfLF7fdPkkSBv5SHzliUt6JeCmwgEyIZViq1aAlSe7g1ynnSuFYFhUYDiY7'}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh', 'rados/test_pool_quota.sh']}}}], 'teuthology_branch': 'master', 'teuthology_sha1': '3082387bba74fcd24c9700593d10418152d53c97', 'timestamp': '2021-03-09_08:22:40', 'tube': 'smithi', 'user': 'kchai', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.25973'} 2021-03-09T08:39:47.108 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-03-09T08:39:47.131 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-03-09T08:39:47.139 DEBUG:teuthology.orchestra.run.smithi091:> sudo install -d -m0777 -- /var/run/ceph 2021-03-09T08:39:47.179 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/run/ceph 2021-03-09T08:39:47.195 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:39:47.195 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/scratch_devs of=/dev/stdout 2021-03-09T08:39:47.243 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-03-09T08:39:47.244 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-03-09T08:39:47.290 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-03-09T08:39:47.290 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-09T08:39:47.291 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 6h/6d Inode: 340 Links: 1 2021-03-09T08:39:47.291 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-09T08:39:47.291 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2021-03-09 08:37:04.666612218 +0000 2021-03-09T08:39:47.291 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2021-03-09 08:37:04.554612222 +0000 2021-03-09T08:39:47.291 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2021-03-09 08:37:04.554612222 +0000 2021-03-09T08:39:47.292 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2021-03-09T08:39:47.299 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2021-03-09T08:39:47.300 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2021-03-09T08:39:47.300 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000367796 s, 1.4 MB/s 2021-03-09T08:39:47.304 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-03-09T08:39:47.352 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-03-09T08:39:47.352 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-09T08:39:47.352 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 6h/6d Inode: 347 Links: 1 2021-03-09T08:39:47.353 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-09T08:39:47.353 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2021-03-09 08:37:04.790612215 +0000 2021-03-09T08:39:47.353 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2021-03-09 08:37:04.786612215 +0000 2021-03-09T08:39:47.353 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2021-03-09 08:37:04.786612215 +0000 2021-03-09T08:39:47.354 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2021-03-09T08:39:47.362 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2021-03-09T08:39:47.362 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2021-03-09T08:39:47.363 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000383324 s, 1.3 MB/s 2021-03-09T08:39:47.369 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-03-09T08:39:47.425 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-03-09T08:39:47.425 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-09T08:39:47.425 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 6h/6d Inode: 353 Links: 1 2021-03-09T08:39:47.425 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-09T08:39:47.426 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2021-03-09 08:37:05.066612207 +0000 2021-03-09T08:39:47.426 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2021-03-09 08:37:05.062612207 +0000 2021-03-09T08:39:47.426 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2021-03-09 08:37:05.062612207 +0000 2021-03-09T08:39:47.426 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2021-03-09T08:39:47.434 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2021-03-09T08:39:47.434 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2021-03-09T08:39:47.435 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000368811 s, 1.4 MB/s 2021-03-09T08:39:47.439 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-03-09T08:39:47.488 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-03-09T08:39:47.488 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-09T08:39:47.489 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 6h/6d Inode: 359 Links: 1 2021-03-09T08:39:47.489 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-09T08:39:47.489 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2021-03-09 08:37:05.434612197 +0000 2021-03-09T08:39:47.489 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2021-03-09 08:37:05.318612200 +0000 2021-03-09T08:39:47.490 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2021-03-09 08:37:05.318612200 +0000 2021-03-09T08:39:47.490 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2021-03-09T08:39:47.497 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2021-03-09T08:39:47.497 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2021-03-09T08:39:47.497 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000334348 s, 1.5 MB/s 2021-03-09T08:39:47.500 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-03-09T08:39:47.500 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:39:47.500 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2021-03-09T08:39:47.508 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-03-09T08:39:47.508 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-03-09T08:39:47.558 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-03-09T08:39:47.559 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-09T08:39:47.559 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 341 Links: 1 2021-03-09T08:39:47.559 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-09T08:39:47.559 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2021-03-09 08:37:12.665788938 +0000 2021-03-09T08:39:47.560 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2021-03-09 08:37:12.541788939 +0000 2021-03-09T08:39:47.560 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2021-03-09 08:37:12.541788939 +0000 2021-03-09T08:39:47.560 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2021-03-09T08:39:47.568 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2021-03-09T08:39:47.569 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2021-03-09T08:39:47.569 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000312057 s, 1.6 MB/s 2021-03-09T08:39:47.572 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-03-09T08:39:47.622 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-03-09T08:39:47.623 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-09T08:39:47.623 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 347 Links: 1 2021-03-09T08:39:47.623 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-09T08:39:47.624 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2021-03-09 08:37:12.945788935 +0000 2021-03-09T08:39:47.624 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2021-03-09 08:37:12.817788936 +0000 2021-03-09T08:39:47.624 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2021-03-09 08:37:12.817788936 +0000 2021-03-09T08:39:47.624 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2021-03-09T08:39:47.632 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2021-03-09T08:39:47.633 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2021-03-09T08:39:47.633 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000365361 s, 1.4 MB/s 2021-03-09T08:39:47.636 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-03-09T08:39:47.686 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-03-09T08:39:47.687 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-09T08:39:47.687 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 353 Links: 1 2021-03-09T08:39:47.687 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-09T08:39:47.687 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2021-03-09 08:37:13.177788932 +0000 2021-03-09T08:39:47.688 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2021-03-09 08:37:13.073788934 +0000 2021-03-09T08:39:47.688 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2021-03-09 08:37:13.073788934 +0000 2021-03-09T08:39:47.688 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2021-03-09T08:39:47.696 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2021-03-09T08:39:47.697 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2021-03-09T08:39:47.697 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000397949 s, 1.3 MB/s 2021-03-09T08:39:47.700 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-03-09T08:39:47.759 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-03-09T08:39:47.760 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-09T08:39:47.760 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-03-09T08:39:47.760 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-09T08:39:47.761 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2021-03-09 08:37:13.477788929 +0000 2021-03-09T08:39:47.761 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2021-03-09 08:37:13.301788931 +0000 2021-03-09T08:39:47.761 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2021-03-09 08:37:13.301788931 +0000 2021-03-09T08:39:47.761 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2021-03-09T08:39:47.762 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2021-03-09T08:39:47.762 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2021-03-09T08:39:47.762 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000388018 s, 1.3 MB/s 2021-03-09T08:39:47.763 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-03-09T08:39:47.764 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi091.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-03-09T08:39:47.764 INFO:tasks.ceph:Generating config... 2021-03-09T08:39:47.767 INFO:tasks.ceph:[client] debug ms = 1 2021-03-09T08:39:47.767 INFO:tasks.ceph:[global] mon client directed command retry = 5 2021-03-09T08:39:47.767 INFO:tasks.ceph:[global] mon election default strategy = 1 2021-03-09T08:39:47.768 INFO:tasks.ceph:[global] ms bind msgr2 = False 2021-03-09T08:39:47.768 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2021-03-09T08:39:47.768 INFO:tasks.ceph:[global] ms type = async 2021-03-09T08:39:47.769 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-03-09T08:39:47.769 INFO:tasks.ceph:[mgr] debug ms = 1 2021-03-09T08:39:47.769 INFO:tasks.ceph:[mon] debug mon = 20 2021-03-09T08:39:47.771 INFO:tasks.ceph:[mon] debug ms = 1 2021-03-09T08:39:47.771 INFO:tasks.ceph:[mon] debug paxos = 20 2021-03-09T08:39:47.772 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2021-03-09T08:39:47.772 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2021-03-09T08:39:47.773 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2021-03-09T08:39:47.773 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2021-03-09T08:39:47.773 INFO:tasks.ceph:[mon] mon scrub interval = 300 2021-03-09T08:39:47.774 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2021-03-09T08:39:47.774 INFO:tasks.ceph:[mon] paxos service trim min = 10 2021-03-09T08:39:47.774 INFO:tasks.ceph:[osd] bdev async discard = True 2021-03-09T08:39:47.775 INFO:tasks.ceph:[osd] bdev enable discard = True 2021-03-09T08:39:47.775 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2021-03-09T08:39:47.776 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-03-09T08:39:47.776 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-03-09T08:39:47.776 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-03-09T08:39:47.777 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-03-09T08:39:47.777 INFO:tasks.ceph:[osd] debug filestore = 20 2021-03-09T08:39:47.778 INFO:tasks.ceph:[osd] debug journal = 20 2021-03-09T08:39:47.779 INFO:tasks.ceph:[osd] debug ms = 20 2021-03-09T08:39:47.779 INFO:tasks.ceph:[osd] debug osd = 25 2021-03-09T08:39:47.779 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-03-09T08:39:47.780 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-03-09T08:39:47.780 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-03-09T08:39:47.780 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-03-09T08:39:47.781 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2021-03-09T08:39:47.781 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2021-03-09T08:39:47.781 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-03-09T08:39:47.782 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-03-09T08:39:47.782 INFO:tasks.ceph:[osd] osd op queue = debug_random 2021-03-09T08:39:47.782 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2021-03-09T08:39:47.783 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2021-03-09T08:39:47.783 INFO:tasks.ceph:Setting up mon.a... 2021-03-09T08:39:47.783 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-03-09T08:39:47.871 INFO:teuthology.orchestra.run.smithi091.stdout:creating /etc/ceph/ceph.keyring 2021-03-09T08:39:47.877 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-03-09T08:39:47.967 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-03-09T08:39:47.982 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.91:6789]'), ('mon.c', '[v1:172.21.15.91:6790]'), ('mon.b', '[v1:172.21.15.106:6789]')] 2021-03-09T08:39:47.983 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.91:6789],[v1:172.21.15.91:6790],[v1:172.21.15.106:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2021-03-09T08:39:47.984 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:39:47.984 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-03-09T08:39:48.032 DEBUG:teuthology.orchestra.run.smithi091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.91:6789]' --addv c '[v1:172.21.15.91:6790]' --addv b '[v1:172.21.15.106:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2021-03-09T08:39:48.162 INFO:teuthology.orchestra.run.smithi091.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-03-09T08:39:48.163 INFO:teuthology.orchestra.run.smithi091.stdout:monmaptool: generated fsid e6444b40-8694-46ba-959c-a5e888845ea5 2021-03-09T08:39:48.163 INFO:teuthology.orchestra.run.smithi091.stdout:setting min_mon_release = octopus 2021-03-09T08:39:48.163 INFO:teuthology.orchestra.run.smithi091.stdout:epoch 0 2021-03-09T08:39:48.163 INFO:teuthology.orchestra.run.smithi091.stdout:fsid e6444b40-8694-46ba-959c-a5e888845ea5 2021-03-09T08:39:48.164 INFO:teuthology.orchestra.run.smithi091.stdout:last_changed 2021-03-09T08:39:48.164658+0000 2021-03-09T08:39:48.164 INFO:teuthology.orchestra.run.smithi091.stdout:created 2021-03-09T08:39:48.164658+0000 2021-03-09T08:39:48.164 INFO:teuthology.orchestra.run.smithi091.stdout:min_mon_release 15 (octopus) 2021-03-09T08:39:48.164 INFO:teuthology.orchestra.run.smithi091.stdout:election_strategy: 1 2021-03-09T08:39:48.164 INFO:teuthology.orchestra.run.smithi091.stdout:0: v1:172.21.15.91:6789/0 mon.a 2021-03-09T08:39:48.165 INFO:teuthology.orchestra.run.smithi091.stdout:1: v1:172.21.15.106:6789/0 mon.b 2021-03-09T08:39:48.165 INFO:teuthology.orchestra.run.smithi091.stdout:2: v1:172.21.15.91:6790/0 mon.c 2021-03-09T08:39:48.165 INFO:teuthology.orchestra.run.smithi091.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-03-09T08:39:48.167 DEBUG:teuthology.orchestra.run.smithi091:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-03-09T08:39:48.174 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e6444b40-8694-46ba-959c-a5e888845ea5... 2021-03-09T08:39:48.175 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-03-09T08:39:48.219 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-03-09T08:39:48.249 INFO:teuthology.orchestra.run.smithi091.stdout:[global] 2021-03-09T08:39:48.250 INFO:teuthology.orchestra.run.smithi091.stdout: chdir = "" 2021-03-09T08:39:48.250 INFO:teuthology.orchestra.run.smithi091.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-03-09T08:39:48.251 INFO:teuthology.orchestra.run.smithi091.stdout: auth supported = cephx 2021-03-09T08:39:48.251 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.251 INFO:teuthology.orchestra.run.smithi091.stdout: filestore xattr use omap = true 2021-03-09T08:39:48.251 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.252 INFO:teuthology.orchestra.run.smithi091.stdout: mon clock drift allowed = 1.000 2021-03-09T08:39:48.252 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.252 INFO:teuthology.orchestra.run.smithi091.stdout: osd crush chooseleaf type = 0 2021-03-09T08:39:48.253 INFO:teuthology.orchestra.run.smithi091.stdout: auth debug = true 2021-03-09T08:39:48.254 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.254 INFO:teuthology.orchestra.run.smithi091.stdout: ms die on old message = true 2021-03-09T08:39:48.254 INFO:teuthology.orchestra.run.smithi091.stdout: ms die on bug = true 2021-03-09T08:39:48.254 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.255 INFO:teuthology.orchestra.run.smithi091.stdout: mon max pg per osd = 10000 # >= luminous 2021-03-09T08:39:48.255 INFO:teuthology.orchestra.run.smithi091.stdout: mon pg warn max object skew = 0 2021-03-09T08:39:48.255 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.255 INFO:teuthology.orchestra.run.smithi091.stdout: # disable pg_autoscaler by default for new pools 2021-03-09T08:39:48.255 INFO:teuthology.orchestra.run.smithi091.stdout: osd_pool_default_pg_autoscale_mode = off 2021-03-09T08:39:48.256 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.256 INFO:teuthology.orchestra.run.smithi091.stdout: osd pool default size = 2 2021-03-09T08:39:48.256 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.256 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd allow primary affinity = true 2021-03-09T08:39:48.257 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd allow pg remap = true 2021-03-09T08:39:48.257 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on legacy crush tunables = false 2021-03-09T08:39:48.257 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on crush straw calc version zero = false 2021-03-09T08:39:48.257 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on no sortbitwise = false 2021-03-09T08:39:48.257 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on osd down out interval zero = false 2021-03-09T08:39:48.258 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on too few osds = false 2021-03-09T08:39:48.258 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-03-09T08:39:48.258 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_pool_no_redundancy = false 2021-03-09T08:39:48.258 INFO:teuthology.orchestra.run.smithi091.stdout: mon_allow_pool_size_one = true 2021-03-09T08:39:48.258 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.259 INFO:teuthology.orchestra.run.smithi091.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-03-09T08:39:48.259 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.259 INFO:teuthology.orchestra.run.smithi091.stdout: osd default data pool replay window = 5 2021-03-09T08:39:48.259 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.260 INFO:teuthology.orchestra.run.smithi091.stdout: mon allow pool delete = true 2021-03-09T08:39:48.260 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.260 INFO:teuthology.orchestra.run.smithi091.stdout: mon cluster log file level = debug 2021-03-09T08:39:48.260 INFO:teuthology.orchestra.run.smithi091.stdout: debug asserts on shutdown = true 2021-03-09T08:39:48.260 INFO:teuthology.orchestra.run.smithi091.stdout: mon health detail to clog = false 2021-03-09T08:39:48.261 INFO:teuthology.orchestra.run.smithi091.stdout: mon host = "[v1:172.21.15.91:6789],[v1:172.21.15.91:6790],[v1:172.21.15.106:6789]" 2021-03-09T08:39:48.261 INFO:teuthology.orchestra.run.smithi091.stdout: mon client directed command retry = 5 2021-03-09T08:39:48.261 INFO:teuthology.orchestra.run.smithi091.stdout: mon election default strategy = 1 2021-03-09T08:39:48.261 INFO:teuthology.orchestra.run.smithi091.stdout: ms bind msgr2 = False 2021-03-09T08:39:48.261 INFO:teuthology.orchestra.run.smithi091.stdout: ms inject socket failures = 5000 2021-03-09T08:39:48.262 INFO:teuthology.orchestra.run.smithi091.stdout: ms type = async 2021-03-09T08:39:48.262 INFO:teuthology.orchestra.run.smithi091.stdout: fsid = e6444b40-8694-46ba-959c-a5e888845ea5 2021-03-09T08:39:48.262 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.262 INFO:teuthology.orchestra.run.smithi091.stdout:[osd] 2021-03-09T08:39:48.263 INFO:teuthology.orchestra.run.smithi091.stdout: osd journal size = 100 2021-03-09T08:39:48.263 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.263 INFO:teuthology.orchestra.run.smithi091.stdout: osd scrub load threshold = 5.0 2021-03-09T08:39:48.264 INFO:teuthology.orchestra.run.smithi091.stdout: osd scrub max interval = 600 2021-03-09T08:39:48.264 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.265 INFO:teuthology.orchestra.run.smithi091.stdout: osd recover clone overlap = true 2021-03-09T08:39:48.265 INFO:teuthology.orchestra.run.smithi091.stdout: osd recovery max chunk = 1048576 2021-03-09T08:39:48.265 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.265 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug shutdown = true 2021-03-09T08:39:48.266 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug op order = true 2021-03-09T08:39:48.266 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug verify stray on activate = true 2021-03-09T08:39:48.266 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.266 INFO:teuthology.orchestra.run.smithi091.stdout: osd open classes on start = true 2021-03-09T08:39:48.267 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug pg log writeout = true 2021-03-09T08:39:48.267 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.267 INFO:teuthology.orchestra.run.smithi091.stdout: osd deep scrub update digest min age = 30 2021-03-09T08:39:48.267 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.267 INFO:teuthology.orchestra.run.smithi091.stdout: osd map max advance = 10 2021-03-09T08:39:48.268 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.268 INFO:teuthology.orchestra.run.smithi091.stdout: journal zero on create = true 2021-03-09T08:39:48.268 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.269 INFO:teuthology.orchestra.run.smithi091.stdout: filestore ondisk finisher threads = 3 2021-03-09T08:39:48.269 INFO:teuthology.orchestra.run.smithi091.stdout: filestore apply finisher threads = 3 2021-03-09T08:39:48.269 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.269 INFO:teuthology.orchestra.run.smithi091.stdout: bdev debug aio = true 2021-03-09T08:39:48.270 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug misdirected ops = true 2021-03-09T08:39:48.270 INFO:teuthology.orchestra.run.smithi091.stdout: bdev async discard = True 2021-03-09T08:39:48.270 INFO:teuthology.orchestra.run.smithi091.stdout: bdev enable discard = True 2021-03-09T08:39:48.270 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore allocator = bitmap 2021-03-09T08:39:48.270 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore block size = 96636764160 2021-03-09T08:39:48.271 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore fsck on mount = True 2021-03-09T08:39:48.271 INFO:teuthology.orchestra.run.smithi091.stdout: debug bluefs = 20 2021-03-09T08:39:48.271 INFO:teuthology.orchestra.run.smithi091.stdout: debug bluestore = 20 2021-03-09T08:39:48.271 INFO:teuthology.orchestra.run.smithi091.stdout: debug filestore = 20 2021-03-09T08:39:48.272 INFO:teuthology.orchestra.run.smithi091.stdout: debug journal = 20 2021-03-09T08:39:48.272 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 20 2021-03-09T08:39:48.272 INFO:teuthology.orchestra.run.smithi091.stdout: debug osd = 25 2021-03-09T08:39:48.272 INFO:teuthology.orchestra.run.smithi091.stdout: debug rocksdb = 10 2021-03-09T08:39:48.272 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd backfillfull_ratio = 0.85 2021-03-09T08:39:48.273 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd full ratio = 0.9 2021-03-09T08:39:48.273 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd nearfull ratio = 0.8 2021-03-09T08:39:48.273 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug verify cached snaps = True 2021-03-09T08:39:48.273 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug verify missing on start = True 2021-03-09T08:39:48.273 INFO:teuthology.orchestra.run.smithi091.stdout: osd failsafe full ratio = 0.95 2021-03-09T08:39:48.274 INFO:teuthology.orchestra.run.smithi091.stdout: osd objectstore = bluestore 2021-03-09T08:39:48.274 INFO:teuthology.orchestra.run.smithi091.stdout: osd op queue = debug_random 2021-03-09T08:39:48.274 INFO:teuthology.orchestra.run.smithi091.stdout: osd op queue cut off = debug_random 2021-03-09T08:39:48.274 INFO:teuthology.orchestra.run.smithi091.stdout: osd shutdown pgref assert = True 2021-03-09T08:39:48.275 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.275 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr] 2021-03-09T08:39:48.275 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2021-03-09T08:39:48.275 INFO:teuthology.orchestra.run.smithi091.stdout: debug mgr = 20 2021-03-09T08:39:48.275 INFO:teuthology.orchestra.run.smithi091.stdout: debug mon = 20 2021-03-09T08:39:48.276 INFO:teuthology.orchestra.run.smithi091.stdout: debug auth = 20 2021-03-09T08:39:48.276 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min pgs per osd = 4 2021-03-09T08:39:48.276 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min bytes per osd = 10 2021-03-09T08:39:48.277 INFO:teuthology.orchestra.run.smithi091.stdout: mgr/telemetry/nag = false 2021-03-09T08:39:48.277 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.277 INFO:teuthology.orchestra.run.smithi091.stdout:[mon] 2021-03-09T08:39:48.277 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2021-03-09T08:39:48.278 INFO:teuthology.orchestra.run.smithi091.stdout: debug mon = 20 2021-03-09T08:39:48.278 INFO:teuthology.orchestra.run.smithi091.stdout: debug paxos = 20 2021-03-09T08:39:48.278 INFO:teuthology.orchestra.run.smithi091.stdout: debug auth = 20 2021-03-09T08:39:48.278 INFO:teuthology.orchestra.run.smithi091.stdout: mon data avail warn = 5 2021-03-09T08:39:48.279 INFO:teuthology.orchestra.run.smithi091.stdout: mon mgr mkfs grace = 240 2021-03-09T08:39:48.279 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min pgs per osd = 4 2021-03-09T08:39:48.279 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd reporter subtree level = osd 2021-03-09T08:39:48.279 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd prime pg temp = true 2021-03-09T08:39:48.279 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min bytes per osd = 10 2021-03-09T08:39:48.280 INFO:teuthology.orchestra.run.smithi091.stdout: mon min osdmap epochs = 50 2021-03-09T08:39:48.280 INFO:teuthology.orchestra.run.smithi091.stdout: mon osdmap full prune interval = 2 2021-03-09T08:39:48.280 INFO:teuthology.orchestra.run.smithi091.stdout: mon osdmap full prune min = 15 2021-03-09T08:39:48.280 INFO:teuthology.orchestra.run.smithi091.stdout: mon osdmap full prune txsize = 2 2021-03-09T08:39:48.281 INFO:teuthology.orchestra.run.smithi091.stdout: mon scrub interval = 300 2021-03-09T08:39:48.281 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on pool no app = False 2021-03-09T08:39:48.281 INFO:teuthology.orchestra.run.smithi091.stdout: paxos service trim min = 10 2021-03-09T08:39:48.281 INFO:teuthology.orchestra.run.smithi091.stdout: 2021-03-09T08:39:48.281 INFO:teuthology.orchestra.run.smithi091.stdout:[client] 2021-03-09T08:39:48.282 INFO:teuthology.orchestra.run.smithi091.stdout: rgw cache enabled = true 2021-03-09T08:39:48.282 INFO:teuthology.orchestra.run.smithi091.stdout: rgw enable ops log = true 2021-03-09T08:39:48.282 INFO:teuthology.orchestra.run.smithi091.stdout: rgw enable usage log = true 2021-03-09T08:39:48.282 INFO:teuthology.orchestra.run.smithi091.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-03-09T08:39:48.282 INFO:teuthology.orchestra.run.smithi091.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-03-09T08:39:48.283 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2021-03-09T08:39:48.283 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.a] 2021-03-09T08:39:48.283 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.c] 2021-03-09T08:39:48.283 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.b] 2021-03-09T08:39:48.285 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2021-03-09T08:39:48.286 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2021-03-09T08:39:48.286 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-03-09T08:39:48.286 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2021-03-09T08:39:48.287 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.287 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2021-03-09T08:39:48.287 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.287 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2021-03-09T08:39:48.288 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.288 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2021-03-09T08:39:48.288 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2021-03-09T08:39:48.288 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.289 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2021-03-09T08:39:48.289 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2021-03-09T08:39:48.289 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.289 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2021-03-09T08:39:48.289 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2021-03-09T08:39:48.290 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.290 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2021-03-09T08:39:48.290 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2021-03-09T08:39:48.290 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2021-03-09T08:39:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2021-03-09T08:39:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2021-03-09T08:39:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2021-03-09T08:39:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2021-03-09T08:39:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2021-03-09T08:39:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2021-03-09T08:39:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2021-03-09T08:39:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-03-09T08:39:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2021-03-09T08:39:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2021-03-09T08:39:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-03-09T08:39:48.294 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.294 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2021-03-09T08:39:48.294 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2021-03-09T08:39:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2021-03-09T08:39:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2021-03-09T08:39:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2021-03-09T08:39:48.296 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "[v1:172.21.15.91:6789],[v1:172.21.15.91:6790],[v1:172.21.15.106:6789]" 2021-03-09T08:39:48.296 INFO:teuthology.orchestra.run.smithi106.stdout: mon client directed command retry = 5 2021-03-09T08:39:48.296 INFO:teuthology.orchestra.run.smithi106.stdout: mon election default strategy = 1 2021-03-09T08:39:48.296 INFO:teuthology.orchestra.run.smithi106.stdout: ms bind msgr2 = False 2021-03-09T08:39:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject socket failures = 5000 2021-03-09T08:39:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: ms type = async 2021-03-09T08:39:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = e6444b40-8694-46ba-959c-a5e888845ea5 2021-03-09T08:39:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.298 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2021-03-09T08:39:48.298 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2021-03-09T08:39:48.298 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.298 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2021-03-09T08:39:48.299 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2021-03-09T08:39:48.299 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.299 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2021-03-09T08:39:48.299 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2021-03-09T08:39:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2021-03-09T08:39:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2021-03-09T08:39:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2021-03-09T08:39:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2021-03-09T08:39:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2021-03-09T08:39:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2021-03-09T08:39:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2021-03-09T08:39:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2021-03-09T08:39:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.303 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2021-03-09T08:39:48.303 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2021-03-09T08:39:48.303 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.304 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2021-03-09T08:39:48.304 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2021-03-09T08:39:48.304 INFO:teuthology.orchestra.run.smithi106.stdout: bdev async discard = True 2021-03-09T08:39:48.304 INFO:teuthology.orchestra.run.smithi106.stdout: bdev enable discard = True 2021-03-09T08:39:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore allocator = bitmap 2021-03-09T08:39:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2021-03-09T08:39:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2021-03-09T08:39:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 20 2021-03-09T08:39:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 20 2021-03-09T08:39:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: debug filestore = 20 2021-03-09T08:39:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: debug journal = 20 2021-03-09T08:39:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 20 2021-03-09T08:39:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 25 2021-03-09T08:39:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 10 2021-03-09T08:39:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2021-03-09T08:39:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2021-03-09T08:39:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2021-03-09T08:39:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify cached snaps = True 2021-03-09T08:39:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify missing on start = True 2021-03-09T08:39:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2021-03-09T08:39:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2021-03-09T08:39:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: osd op queue = debug_random 2021-03-09T08:39:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: osd op queue cut off = debug_random 2021-03-09T08:39:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: osd shutdown pgref assert = True 2021-03-09T08:39:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.310 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2021-03-09T08:39:48.310 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2021-03-09T08:39:48.310 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2021-03-09T08:39:48.310 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2021-03-09T08:39:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2021-03-09T08:39:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2021-03-09T08:39:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2021-03-09T08:39:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2021-03-09T08:39:48.312 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.312 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2021-03-09T08:39:48.312 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2021-03-09T08:39:48.312 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2021-03-09T08:39:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2021-03-09T08:39:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2021-03-09T08:39:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2021-03-09T08:39:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2021-03-09T08:39:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2021-03-09T08:39:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2021-03-09T08:39:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2021-03-09T08:39:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2021-03-09T08:39:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: mon min osdmap epochs = 50 2021-03-09T08:39:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: mon osdmap full prune interval = 2 2021-03-09T08:39:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: mon osdmap full prune min = 15 2021-03-09T08:39:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: mon osdmap full prune txsize = 2 2021-03-09T08:39:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: mon scrub interval = 300 2021-03-09T08:39:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on pool no app = False 2021-03-09T08:39:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: paxos service trim min = 10 2021-03-09T08:39:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-03-09T08:39:48.316 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2021-03-09T08:39:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2021-03-09T08:39:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2021-03-09T08:39:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2021-03-09T08:39:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-03-09T08:39:48.318 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-03-09T08:39:48.318 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2021-03-09T08:39:48.318 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2021-03-09T08:39:48.318 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2021-03-09T08:39:48.318 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2021-03-09T08:39:48.319 INFO:tasks.ceph:Creating admin key on mon.a... 2021-03-09T08:39:48.320 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-03-09T08:39:48.436 INFO:tasks.ceph:Copying monmap to all nodes... 2021-03-09T08:39:48.437 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:39:48.437 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2021-03-09T08:39:48.443 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:39:48.443 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2021-03-09T08:39:48.492 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi091.front.sepia.ceph.com 2021-03-09T08:39:48.492 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:39:48.493 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/ceph/ceph.keyring 2021-03-09T08:39:48.493 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-03-09T08:39:48.557 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:39:48.557 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-03-09T08:39:48.603 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi106.front.sepia.ceph.com 2021-03-09T08:39:48.604 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:39:48.604 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.keyring 2021-03-09T08:39:48.605 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-03-09T08:39:48.628 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:39:48.629 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-03-09T08:39:48.678 INFO:tasks.ceph:Setting up mon nodes... 2021-03-09T08:39:48.679 INFO:tasks.ceph:Setting up mgr nodes... 2021-03-09T08:39:48.679 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2021-03-09T08:39:48.777 INFO:teuthology.orchestra.run.smithi091.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2021-03-09T08:39:48.783 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-03-09T08:39:48.881 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-03-09T08:39:48.887 INFO:tasks.ceph:Setting up mds nodes... 2021-03-09T08:39:48.887 INFO:tasks.ceph_client:Setting up client nodes... 2021-03-09T08:39:48.888 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-03-09T08:39:48.973 INFO:teuthology.orchestra.run.smithi091.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-03-09T08:39:48.988 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-03-09T08:39:49.075 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.client.1.keyring 2021-03-09T08:39:49.091 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-03-09T08:39:49.091 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi091.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-03-09T08:39:49.092 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-03-09T08:39:49.107 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-03-09T08:39:49.107 INFO:tasks.ceph:role: osd.0 2021-03-09T08:39:49.107 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi091.front.sepia.ceph.com 2021-03-09T08:39:49.108 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-03-09T08:39:49.618 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-03-09T08:39:49.619 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-09T08:39:49.619 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-03-09T08:39:49.619 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-09T08:39:49.619 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2021-03-09T08:39:49.620 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-03-09T08:39:49.620 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-09T08:39:49.620 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-09T08:39:49.620 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-09T08:39:49.621 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2021-03-09T08:39:49.622 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-03-09T08:39:49.701 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-03-09T08:39:49.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-09T08:39:49.721 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: /sbin/restorecon: command not found 2021-03-09T08:39:49.722 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-03-09T08:39:49.788 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-03-09T08:39:49.788 INFO:tasks.ceph:role: osd.1 2021-03-09T08:39:49.789 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi091.front.sepia.ceph.com 2021-03-09T08:39:49.789 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-03-09T08:39:50.308 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-03-09T08:39:50.309 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-09T08:39:50.309 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-03-09T08:39:50.309 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-09T08:39:50.309 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2021-03-09T08:39:50.310 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-03-09T08:39:50.310 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-09T08:39:50.310 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-09T08:39:50.310 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-09T08:39:50.312 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2021-03-09T08:39:50.312 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-03-09T08:39:50.373 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-03-09T08:39:50.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-09T08:39:50.385 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: /sbin/restorecon: command not found 2021-03-09T08:39:50.386 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-03-09T08:39:50.445 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-03-09T08:39:50.446 INFO:tasks.ceph:role: osd.2 2021-03-09T08:39:50.446 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi091.front.sepia.ceph.com 2021-03-09T08:39:50.447 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-03-09T08:39:50.948 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-03-09T08:39:50.948 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-09T08:39:50.948 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-03-09T08:39:50.948 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-09T08:39:50.949 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2021-03-09T08:39:50.949 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-03-09T08:39:50.949 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-09T08:39:50.949 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-09T08:39:50.950 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-09T08:39:50.951 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2021-03-09T08:39:50.951 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-03-09T08:39:51.006 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-03-09T08:39:51.018 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: /sbin/restorecon: command not found 2021-03-09T08:39:51.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-09T08:39:51.019 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-03-09T08:39:51.075 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-03-09T08:39:51.075 INFO:tasks.ceph:role: osd.3 2021-03-09T08:39:51.076 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi091.front.sepia.ceph.com 2021-03-09T08:39:51.076 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-03-09T08:39:51.613 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-03-09T08:39:51.613 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-09T08:39:51.613 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-03-09T08:39:51.614 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-09T08:39:51.614 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2021-03-09T08:39:51.614 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-03-09T08:39:51.614 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-09T08:39:51.615 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-09T08:39:51.615 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-09T08:39:51.616 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2021-03-09T08:39:51.616 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2021-03-09T08:39:51.687 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-03-09T08:39:51.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-09T08:39:51.760 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: /sbin/restorecon: command not found 2021-03-09T08:39:51.761 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-03-09T08:39:51.940 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:51.940+0000 7f4d8bee7f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-03-09T08:39:51.941 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:51.940+0000 7f4d8bee7f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-03-09T08:39:51.941 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:51.940+0000 7f4d8bee7f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-03-09T08:39:51.941 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:51.940+0000 7f4d8bee7f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-03-09T08:39:51.941 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:51.940+0000 7f4d8bee7f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-03-09T08:39:51.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:51.948+0000 7f4d8bee7f00 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2021-03-09T08:39:54.925 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-09T08:39:54.939 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-03-09T08:39:55.079 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:55.080+0000 7f93c5365f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-03-09T08:39:55.080 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:55.080+0000 7f93c5365f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-03-09T08:39:55.080 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:55.080+0000 7f93c5365f00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-03-09T08:39:55.080 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:55.080+0000 7f93c5365f00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-03-09T08:39:55.081 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:55.080+0000 7f93c5365f00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-03-09T08:39:55.081 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:55.080+0000 7f93c5365f00 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2021-03-09T08:39:58.045 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-09T08:39:58.068 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-03-09T08:39:58.206 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:58.204+0000 7ff7cae03f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-03-09T08:39:58.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:58.208+0000 7ff7cae03f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-03-09T08:39:58.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:58.208+0000 7ff7cae03f00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-03-09T08:39:58.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:58.208+0000 7ff7cae03f00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-03-09T08:39:58.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:58.208+0000 7ff7cae03f00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-03-09T08:39:58.209 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:39:58.208+0000 7ff7cae03f00 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2021-03-09T08:40:01.191 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-09T08:40:01.209 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-03-09T08:40:01.343 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:01.344+0000 7f49d153df00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-03-09T08:40:01.343 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:01.344+0000 7f49d153df00 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-03-09T08:40:01.343 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:01.344+0000 7f49d153df00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-03-09T08:40:01.344 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:01.344+0000 7f49d153df00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-03-09T08:40:01.344 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:01.344+0000 7f49d153df00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-03-09T08:40:01.345 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:01.344+0000 7f49d153df00 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2021-03-09T08:40:04.312 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-09T08:40:04.326 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-03-09T08:40:04.343 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-03-09T08:40:04.343 INFO:tasks.ceph:role: osd.4 2021-03-09T08:40:04.344 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com 2021-03-09T08:40:04.344 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-03-09T08:40:04.870 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-03-09T08:40:04.871 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-09T08:40:04.871 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-03-09T08:40:04.871 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-09T08:40:04.872 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2021-03-09T08:40:04.872 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-03-09T08:40:04.872 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-09T08:40:04.872 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-09T08:40:04.873 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-09T08:40:04.874 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2021-03-09T08:40:04.874 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2021-03-09T08:40:04.962 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-03-09T08:40:05.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-09T08:40:05.013 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2021-03-09T08:40:05.014 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-03-09T08:40:05.073 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-03-09T08:40:05.073 INFO:tasks.ceph:role: osd.5 2021-03-09T08:40:05.074 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com 2021-03-09T08:40:05.075 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-03-09T08:40:05.601 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-03-09T08:40:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-09T08:40:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-03-09T08:40:05.602 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-09T08:40:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2021-03-09T08:40:05.603 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-03-09T08:40:05.603 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-09T08:40:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-09T08:40:05.603 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-09T08:40:05.604 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2021-03-09T08:40:05.605 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2021-03-09T08:40:05.645 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-03-09T08:40:05.704 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-09T08:40:05.705 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2021-03-09T08:40:05.706 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2021-03-09T08:40:05.772 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-03-09T08:40:05.772 INFO:tasks.ceph:role: osd.6 2021-03-09T08:40:05.773 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com 2021-03-09T08:40:05.773 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-03-09T08:40:06.308 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-03-09T08:40:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-09T08:40:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-03-09T08:40:06.310 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-09T08:40:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2021-03-09T08:40:06.311 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-03-09T08:40:06.311 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-09T08:40:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-09T08:40:06.312 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-09T08:40:06.313 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2021-03-09T08:40:06.313 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2021-03-09T08:40:06.368 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2021-03-09T08:40:06.428 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2021-03-09T08:40:06.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-09T08:40:06.430 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2021-03-09T08:40:06.491 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-03-09T08:40:06.492 INFO:tasks.ceph:role: osd.7 2021-03-09T08:40:06.492 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com 2021-03-09T08:40:06.492 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-03-09T08:40:07.038 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-03-09T08:40:07.039 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-09T08:40:07.039 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-03-09T08:40:07.039 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-09T08:40:07.039 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2021-03-09T08:40:07.039 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-03-09T08:40:07.040 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-09T08:40:07.040 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-09T08:40:07.040 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-09T08:40:07.041 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2021-03-09T08:40:07.042 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2021-03-09T08:40:07.115 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2021-03-09T08:40:07.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-09T08:40:07.127 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2021-03-09T08:40:07.127 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-03-09T08:40:07.291 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:07.289+0000 7f4ca5822f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-03-09T08:40:07.293 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:07.293+0000 7f4ca5822f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-03-09T08:40:07.294 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:07.293+0000 7f4ca5822f00 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-03-09T08:40:07.294 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:07.293+0000 7f4ca5822f00 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-03-09T08:40:07.295 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:07.293+0000 7f4ca5822f00 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-03-09T08:40:07.301 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:07.301+0000 7f4ca5822f00 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2021-03-09T08:40:10.296 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-09T08:40:10.311 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-03-09T08:40:10.446 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:10.445+0000 7fde3008ff00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-03-09T08:40:10.447 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:10.445+0000 7fde3008ff00 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-03-09T08:40:10.447 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:10.445+0000 7fde3008ff00 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-03-09T08:40:10.447 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:10.445+0000 7fde3008ff00 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-03-09T08:40:10.447 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:10.445+0000 7fde3008ff00 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-03-09T08:40:10.448 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:10.445+0000 7fde3008ff00 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2021-03-09T08:40:13.430 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-09T08:40:13.446 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-03-09T08:40:13.583 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:13.581+0000 7f6a6381ef00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2021-03-09T08:40:13.584 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:13.581+0000 7f6a6381ef00 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2021-03-09T08:40:13.584 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:13.581+0000 7f6a6381ef00 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-03-09T08:40:13.584 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:13.585+0000 7f6a6381ef00 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-03-09T08:40:13.585 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:13.585+0000 7f6a6381ef00 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-03-09T08:40:13.585 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:13.585+0000 7f6a6381ef00 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2021-03-09T08:40:16.555 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-09T08:40:16.578 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-03-09T08:40:16.724 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:16.721+0000 7fab9297af00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2021-03-09T08:40:16.724 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:16.721+0000 7fab9297af00 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2021-03-09T08:40:16.725 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:16.721+0000 7fab9297af00 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-03-09T08:40:16.725 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:16.721+0000 7fab9297af00 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-03-09T08:40:16.726 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:16.721+0000 7fab9297af00 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-03-09T08:40:16.726 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:16.725+0000 7fab9297af00 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2021-03-09T08:40:19.677 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-09T08:40:19.692 INFO:tasks.ceph:Reading keys from all nodes... 2021-03-09T08:40:19.693 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:40:19.693 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2021-03-09T08:40:19.708 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:40:19.709 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2021-03-09T08:40:19.767 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:40:19.768 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2021-03-09T08:40:19.823 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:40:19.823 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2021-03-09T08:40:19.883 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:40:19.883 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2021-03-09T08:40:19.938 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:40:19.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2021-03-09T08:40:19.954 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:40:19.955 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2021-03-09T08:40:20.009 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:40:20.010 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2021-03-09T08:40:20.065 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:40:20.065 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2021-03-09T08:40:20.121 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:40:20.122 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2021-03-09T08:40:20.177 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:40:20.177 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2021-03-09T08:40:20.183 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:40:20.183 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2021-03-09T08:40:20.225 INFO:tasks.ceph:Adding keys to all mons... 2021-03-09T08:40:20.225 DEBUG:teuthology.orchestra.run.smithi091:> sudo tee -a /etc/ceph/ceph.keyring 2021-03-09T08:40:20.228 DEBUG:teuthology.orchestra.run.smithi106:> sudo tee -a /etc/ceph/ceph.keyring 2021-03-09T08:40:20.270 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr.y] 2021-03-09T08:40:20.270 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQBUNEdghZ15LhAA5rNHoB4ic+DRHeFAy2cRVA== 2021-03-09T08:40:20.270 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.0] 2021-03-09T08:40:20.270 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQBXNEdgH1UkOBAA4cIPC/M+d1lGD8qFLMGZrA== 2021-03-09T08:40:20.271 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.1] 2021-03-09T08:40:20.271 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQBbNEdgIM7WBBAAm1WgnYsmNch5SLaVqOJbDg== 2021-03-09T08:40:20.271 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.2] 2021-03-09T08:40:20.271 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQBeNEdgmjxoDBAACjCeq49FGGS2JJ9Wh4JcLw== 2021-03-09T08:40:20.272 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.3] 2021-03-09T08:40:20.272 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQBhNEdg9ImRFBAAlKuG6TwATMTAR64V1g9RSQ== 2021-03-09T08:40:20.272 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr.x] 2021-03-09T08:40:20.272 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQBUNEdgORavNBAAGOU/DixgPoaPo8iNMw5vBA== 2021-03-09T08:40:20.272 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.4] 2021-03-09T08:40:20.273 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQBnNEdgveeKERAAHaurByKrb21Ox3pO6lanxg== 2021-03-09T08:40:20.273 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.5] 2021-03-09T08:40:20.273 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQBqNEdgGyzKGhAAw8ZV6gW1gv32twF5LVW/Pg== 2021-03-09T08:40:20.273 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.6] 2021-03-09T08:40:20.273 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQBtNEdg+OP2IhAA4buF0r8MyvF+plZwRssqDw== 2021-03-09T08:40:20.274 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.7] 2021-03-09T08:40:20.274 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQBwNEdgsYhIKxAAyHGbWk+DXqN5FbHxZl1oIA== 2021-03-09T08:40:20.274 INFO:teuthology.orchestra.run.smithi091.stdout:[client.0] 2021-03-09T08:40:20.274 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQBUNEdgwzAvOhAAjjj8zLwB83Di6zkAVFQK6g== 2021-03-09T08:40:20.275 INFO:teuthology.orchestra.run.smithi091.stdout:[client.1] 2021-03-09T08:40:20.275 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQBVNEdgF9KqBBAAHpuE5Mtwe93hhE0DhK6vBQ== 2021-03-09T08:40:20.280 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.y] 2021-03-09T08:40:20.280 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBUNEdghZ15LhAA5rNHoB4ic+DRHeFAy2cRVA== 2021-03-09T08:40:20.280 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.0] 2021-03-09T08:40:20.280 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBXNEdgH1UkOBAA4cIPC/M+d1lGD8qFLMGZrA== 2021-03-09T08:40:20.282 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.1] 2021-03-09T08:40:20.283 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBbNEdgIM7WBBAAm1WgnYsmNch5SLaVqOJbDg== 2021-03-09T08:40:20.283 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.2] 2021-03-09T08:40:20.283 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBeNEdgmjxoDBAACjCeq49FGGS2JJ9Wh4JcLw== 2021-03-09T08:40:20.283 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.3] 2021-03-09T08:40:20.284 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBhNEdg9ImRFBAAlKuG6TwATMTAR64V1g9RSQ== 2021-03-09T08:40:20.284 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.x] 2021-03-09T08:40:20.284 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBUNEdgORavNBAAGOU/DixgPoaPo8iNMw5vBA== 2021-03-09T08:40:20.284 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.4] 2021-03-09T08:40:20.284 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBnNEdgveeKERAAHaurByKrb21Ox3pO6lanxg== 2021-03-09T08:40:20.285 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.5] 2021-03-09T08:40:20.285 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBqNEdgGyzKGhAAw8ZV6gW1gv32twF5LVW/Pg== 2021-03-09T08:40:20.285 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.6] 2021-03-09T08:40:20.285 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBtNEdg+OP2IhAA4buF0r8MyvF+plZwRssqDw== 2021-03-09T08:40:20.286 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.7] 2021-03-09T08:40:20.286 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBwNEdgsYhIKxAAyHGbWk+DXqN5FbHxZl1oIA== 2021-03-09T08:40:20.286 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2021-03-09T08:40:20.286 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBUNEdgwzAvOhAAjjj8zLwB83Di6zkAVFQK6g== 2021-03-09T08:40:20.286 INFO:teuthology.orchestra.run.smithi106.stdout:[client.1] 2021-03-09T08:40:20.287 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBVNEdgF9KqBBAAHpuE5Mtwe93hhE0DhK6vBQ== 2021-03-09T08:40:20.288 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-03-09T08:40:20.322 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-03-09T08:40:20.433 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-09T08:40:20.436 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-09T08:40:20.532 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-09T08:40:20.534 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-09T08:40:20.630 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-09T08:40:20.633 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-09T08:40:20.727 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-09T08:40:20.729 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-09T08:40:20.822 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-03-09T08:40:20.825 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-03-09T08:40:20.922 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-09T08:40:20.925 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-09T08:40:21.017 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-09T08:40:21.020 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-09T08:40:21.110 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-09T08:40:21.113 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-09T08:40:21.205 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-09T08:40:21.208 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-09T08:40:21.307 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-03-09T08:40:21.309 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-03-09T08:40:21.406 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-03-09T08:40:21.408 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-03-09T08:40:21.506 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-03-09T08:40:21.507 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-03-09T08:40:21.520 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-03-09T08:40:21.684 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-03-09T08:40:21.698 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-03-09T08:40:21.755 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-03-09T08:40:21.919 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-03-09T08:40:21.933 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-03-09T08:40:21.949 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-03-09T08:40:22.111 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-03-09T08:40:22.125 DEBUG:teuthology.orchestra.run.smithi091:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-03-09T08:40:22.128 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-03-09T08:40:22.172 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-03-09T08:40:22.173 INFO:tasks.ceph.mon.a:Restarting daemon 2021-03-09T08:40:22.174 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-03-09T08:40:22.177 INFO:tasks.ceph.mon.a:Started 2021-03-09T08:40:22.177 INFO:tasks.ceph.mon.c:Restarting daemon 2021-03-09T08:40:22.178 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-03-09T08:40:22.180 INFO:tasks.ceph.mon.c:Started 2021-03-09T08:40:22.180 INFO:tasks.ceph.mon.b:Restarting daemon 2021-03-09T08:40:22.181 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-03-09T08:40:22.217 INFO:tasks.ceph.mon.b:Started 2021-03-09T08:40:22.218 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-03-09T08:40:22.218 INFO:tasks.ceph.mgr.y:Restarting daemon 2021-03-09T08:40:22.219 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2021-03-09T08:40:22.222 INFO:tasks.ceph.mgr.y:Started 2021-03-09T08:40:22.222 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-03-09T08:40:22.223 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-03-09T08:40:22.226 INFO:tasks.ceph.mgr.x:Started 2021-03-09T08:40:22.227 INFO:tasks.ceph:Setting crush tunables to default 2021-03-09T08:40:22.227 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd crush tunables default 2021-03-09T08:40:22.505 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:22.508+0000 7f4c5f59e700 1 Processor -- start 2021-03-09T08:40:22.506 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:22.508+0000 7f4c5f59e700 1 -- start start 2021-03-09T08:40:22.507 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:22.508+0000 7f4c5f59e700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c600622e0 con 0x7f4c6009eac0 2021-03-09T08:40:22.507 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:22.508+0000 7f4c5f59e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c6009efd0 con 0x7f4c60061f00 2021-03-09T08:40:22.507 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:22.508+0000 7f4c5f59e700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c600a4d40 con 0x7f4c6009d4e0 2021-03-09T08:40:22.508 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:22.508+0000 7f4c5ed9d700 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f4c6009eac0 0x7f4c60141a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:46060/0 (socket says 172.21.15.91:46060) 2021-03-09T08:40:22.508 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:22.508+0000 7f4c5ed9d700 1 -- 172.21.15.91:0/996989217 learned_addr learned my addr 172.21.15.91:0/996989217 (peer_addr_for_me v1:172.21.15.91:0/0) 2021-03-09T08:40:25.507 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:25.508+0000 7f4c4ffff700 1 -- 172.21.15.91:0/996989217 >> v1:172.21.15.91:6790/0 conn(0x7f4c6009d4e0 legacy=0x7f4c60067fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:25.508 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:25.508+0000 7f4c4ffff700 1 -- 172.21.15.91:0/996989217 >> v1:172.21.15.106:6789/0 conn(0x7f4c60061f00 legacy=0x7f4c601361b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:25.508 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:25.508+0000 7f4c4ffff700 1 -- 172.21.15.91:0/996989217 >> v1:172.21.15.91:6789/0 conn(0x7f4c6009eac0 legacy=0x7f4c60141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:25.508 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:25.508+0000 7f4c4ffff700 1 -- 172.21.15.91:0/996989217 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c6009f470 con 0x7f4c6009eac0 2021-03-09T08:40:25.508 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:25.508+0000 7f4c4ffff700 1 -- 172.21.15.91:0/996989217 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3c00f010 con 0x7f4c60061f00 2021-03-09T08:40:25.508 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:25.508+0000 7f4c4ffff700 1 -- 172.21.15.91:0/996989217 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3c010220 con 0x7f4c3c0033c0 2021-03-09T08:40:27.607 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.608+0000 7f4c5d59a700 1 -- 172.21.15.91:0/996989217 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547080975 0 0) 0x7f4c6009f470 con 0x7f4c6009eac0 2021-03-09T08:40:27.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.608+0000 7f4c5d59a700 1 -- 172.21.15.91:0/996989217 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c44003230 con 0x7f4c6009eac0 2021-03-09T08:40:27.621 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.608+0000 7f4c5d59a700 1 -- 172.21.15.91:0/996989217 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857746042 0 0) 0x7f4c3c010220 con 0x7f4c3c0033c0 2021-03-09T08:40:27.621 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.608+0000 7f4c5d59a700 1 -- 172.21.15.91:0/996989217 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c6009f470 con 0x7f4c3c0033c0 2021-03-09T08:40:27.622 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.608+0000 7f4c5d59a700 1 -- 172.21.15.91:0/996989217 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244540854 0 0) 0x7f4c3c00f010 con 0x7f4c60061f00 2021-03-09T08:40:27.622 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.608+0000 7f4c5d59a700 1 -- 172.21.15.91:0/996989217 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c3c010220 con 0x7f4c60061f00 2021-03-09T08:40:27.622 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.612+0000 7f4c5d59a700 1 -- 172.21.15.91:0/996989217 <== mon.2 v1:172.21.15.91:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2971195226 0 0) 0x7f4c6009f470 con 0x7f4c3c0033c0 2021-03-09T08:40:27.625 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.612+0000 7f4c5d59a700 1 -- 172.21.15.91:0/996989217 >> v1:172.21.15.106:6789/0 conn(0x7f4c60061f00 legacy=0x7f4c3c008fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:27.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.612+0000 7f4c5d59a700 1 -- 172.21.15.91:0/996989217 >> v1:172.21.15.91:6789/0 conn(0x7f4c6009eac0 legacy=0x7f4c3c00c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:27.628 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.612+0000 7f4c5d59a700 1 -- 172.21.15.91:0/996989217 --> v1:172.21.15.91:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3c011470 con 0x7f4c3c0033c0 2021-03-09T08:40:27.629 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.612+0000 7f4c5d59a700 1 -- 172.21.15.91:0/996989217 <== mon.2 v1:172.21.15.91:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f4c50001640 con 0x7f4c3c0033c0 2021-03-09T08:40:27.633 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.612+0000 7f4c5d59a700 1 -- 172.21.15.91:0/996989217 <== mon.2 v1:172.21.15.91:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4c50001860 con 0x7f4c3c0033c0 2021-03-09T08:40:27.634 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.612+0000 7f4c5d59a700 1 -- 172.21.15.91:0/996989217 <== mon.2 v1:172.21.15.91:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f4c50001bf0 con 0x7f4c3c0033c0 2021-03-09T08:40:27.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.612+0000 7f4c5f59e700 1 -- 172.21.15.91:0/996989217 >> v1:172.21.15.91:6790/0 conn(0x7f4c3c0033c0 legacy=0x7f4c3c005810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:27.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.612+0000 7f4c5f59e700 1 -- 172.21.15.91:0/996989217 shutdown_connections 2021-03-09T08:40:27.641 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.612+0000 7f4c5f59e700 1 -- 172.21.15.91:0/996989217 >> 172.21.15.91:0/996989217 conn(0x7f4c600a9750 msgr2=0x7f4c600a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:27.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.612+0000 7f4c5f59e700 1 -- 172.21.15.91:0/996989217 shutdown_connections 2021-03-09T08:40:27.644 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.612+0000 7f4c5f59e700 1 -- 172.21.15.91:0/996989217 wait complete. 2021-03-09T08:40:27.644 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.612+0000 7f4c5f59e700 1 Processor -- start 2021-03-09T08:40:27.645 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.612+0000 7f4c5f59e700 1 -- start start 2021-03-09T08:40:27.646 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c5f59e700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c601464a0 con 0x7f4c60061f00 2021-03-09T08:40:27.646 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c5f59e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c60146940 con 0x7f4c6009eac0 2021-03-09T08:40:27.647 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c5f59e700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c601457c0 con 0x7f4c3c0033c0 2021-03-09T08:40:27.648 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c5e59c700 1 --1- >> v1:172.21.15.91:6790/0 conn(0x7f4c3c0033c0 0x7f4c601450b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.91:6790/0 says I am v1:172.21.15.91:50074/0 (socket says 172.21.15.91:50074) 2021-03-09T08:40:27.649 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c5e59c700 1 -- 172.21.15.91:0/2104975663 learned_addr learned my addr 172.21.15.91:0/2104975663 (peer_addr_for_me v1:172.21.15.91:0/0) 2021-03-09T08:40:27.651 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c4e7fc700 1 -- 172.21.15.91:0/2104975663 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146936001 0 0) 0x7f4c601457c0 con 0x7f4c3c0033c0 2021-03-09T08:40:27.652 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c4e7fc700 1 -- 172.21.15.91:0/2104975663 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c3c010300 con 0x7f4c3c0033c0 2021-03-09T08:40:27.652 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c4e7fc700 1 -- 172.21.15.91:0/2104975663 <== mon.2 v1:172.21.15.91:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1672294744 0 0) 0x7f4c3c010300 con 0x7f4c3c0033c0 2021-03-09T08:40:27.653 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c4e7fc700 1 -- 172.21.15.91:0/2104975663 --> v1:172.21.15.91:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4c601457c0 con 0x7f4c3c0033c0 2021-03-09T08:40:27.653 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c4e7fc700 1 -- 172.21.15.91:0/2104975663 <== mon.2 v1:172.21.15.91:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f4c50001de0 con 0x7f4c3c0033c0 2021-03-09T08:40:27.655 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c4e7fc700 1 -- 172.21.15.91:0/2104975663 <== mon.2 v1:172.21.15.91:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2851650853 0 0) 0x7f4c601457c0 con 0x7f4c3c0033c0 2021-03-09T08:40:27.656 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c4e7fc700 1 -- 172.21.15.91:0/2104975663 >> v1:172.21.15.106:6789/0 conn(0x7f4c6009eac0 legacy=0x7f4c600a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:27.656 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c4e7fc700 1 -- 172.21.15.91:0/2104975663 >> v1:172.21.15.91:6789/0 conn(0x7f4c60061f00 legacy=0x7f4c60114d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:27.657 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c4e7fc700 1 -- 172.21.15.91:0/2104975663 --> v1:172.21.15.91:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c600a1b40 con 0x7f4c3c0033c0 2021-03-09T08:40:27.657 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c5f59e700 1 -- 172.21.15.91:0/2104975663 --> v1:172.21.15.91:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c60135d80 con 0x7f4c3c0033c0 2021-03-09T08:40:27.657 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c5f59e700 1 -- 172.21.15.91:0/2104975663 --> v1:172.21.15.91:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c60145f90 con 0x7f4c3c0033c0 2021-03-09T08:40:27.658 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c4e7fc700 1 -- 172.21.15.91:0/2104975663 <== mon.2 v1:172.21.15.91:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4c500023a0 con 0x7f4c3c0033c0 2021-03-09T08:40:27.658 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c4e7fc700 1 -- 172.21.15.91:0/2104975663 <== mon.2 v1:172.21.15.91:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f4c500026b0 con 0x7f4c3c0033c0 2021-03-09T08:40:27.658 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c4e7fc700 1 -- 172.21.15.91:0/2104975663 <== mon.2 v1:172.21.15.91:6790/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7f4c500052a0 con 0x7f4c3c0033c0 2021-03-09T08:40:27.659 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.616+0000 7f4c4e7fc700 1 -- 172.21.15.91:0/2104975663 <== mon.2 v1:172.21.15.91:6790/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (unknown 3024977852 0 0) 0x7f4c50006270 con 0x7f4c3c0033c0 2021-03-09T08:40:27.659 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.620+0000 7f4c5f59e700 1 -- 172.21.15.91:0/2104975663 --> v1:172.21.15.91:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c40004d60 con 0x7f4c3c0033c0 2021-03-09T08:40:27.660 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.620+0000 7f4c4e7fc700 1 -- 172.21.15.91:0/2104975663 <== mon.2 v1:172.21.15.91:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (unknown 1092875540 0 637523725) 0x7f4c500055e0 con 0x7f4c3c0033c0 2021-03-09T08:40:27.720 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.720+0000 7f4c5f59e700 1 -- 172.21.15.91:0/2104975663 --> v1:172.21.15.91:6790/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4c40005010 con 0x7f4c3c0033c0 2021-03-09T08:40:27.731 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.728+0000 7f4c4e7fc700 1 -- 172.21.15.91:0/2104975663 <== mon.2 v1:172.21.15.91:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (unknown 2277712955 0 0) 0x7f4c500058f0 con 0x7f4c3c0033c0 2021-03-09T08:40:27.731 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.732+0000 7f4c5f59e700 1 -- 172.21.15.91:0/2104975663 >> v1:172.21.15.91:6790/0 conn(0x7f4c3c0033c0 legacy=0x7f4c601450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:27.732 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.732+0000 7f4c5f59e700 1 -- 172.21.15.91:0/2104975663 shutdown_connections 2021-03-09T08:40:27.732 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.732+0000 7f4c5f59e700 1 -- 172.21.15.91:0/2104975663 >> 172.21.15.91:0/2104975663 conn(0x7f4c600a9750 msgr2=0x7f4c601364d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:27.732 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.732+0000 7f4c5f59e700 1 -- 172.21.15.91:0/2104975663 shutdown_connections 2021-03-09T08:40:27.732 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:27.732+0000 7f4c5f59e700 1 -- 172.21.15.91:0/2104975663 wait complete. 2021-03-09T08:40:27.732 INFO:teuthology.orchestra.run.smithi091.stderr:adjusted tunables profile to default 2021-03-09T08:40:27.746 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-03-09T08:40:27.747 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:40:27.747 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2021-03-09T08:40:27.760 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:40:27.760 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2021-03-09T08:40:27.818 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:40:27.819 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2021-03-09T08:40:27.877 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2021-03-09T08:40:27.878 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2021-03-09T08:40:27.939 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:40:27.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2021-03-09T08:40:27.957 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:40:27.957 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2021-03-09T08:40:28.016 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:40:28.016 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2021-03-09T08:40:28.090 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-03-09T08:40:28.091 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2021-03-09T08:40:28.140 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new d320711c-c382-48d3-bde9-d4787c3c1b58 0 2021-03-09T08:40:28.440 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cbb59e700 1 Processor -- start 2021-03-09T08:40:28.441 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cbb59e700 1 -- start start 2021-03-09T08:40:28.443 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cbb59e700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc0a5de0 con 0x7f1cbc060d50 2021-03-09T08:40:28.444 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cbb59e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc0677d0 con 0x7f1cbc0a2000 2021-03-09T08:40:28.444 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cbb59e700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc061130 con 0x7f1cbc066dd0 2021-03-09T08:40:28.444 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cbad9d700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1cbc0a2000 0x7f1cbc141800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42180/0 (socket says 172.21.15.106:42180) 2021-03-09T08:40:28.444 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cbad9d700 1 -- 172.21.15.106:0/273211355 learned_addr learned my addr 172.21.15.106:0/273211355 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-03-09T08:40:28.444 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cb9d9b700 1 -- 172.21.15.106:0/273211355 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131485420 0 0) 0x7f1cbc0677d0 con 0x7f1cbc0a2000 2021-03-09T08:40:28.445 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cb9d9b700 1 -- 172.21.15.106:0/273211355 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c9c003230 con 0x7f1cbc0a2000 2021-03-09T08:40:28.445 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cb9d9b700 1 -- 172.21.15.106:0/273211355 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382932460 0 0) 0x7f1cbc061130 con 0x7f1cbc066dd0 2021-03-09T08:40:28.445 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cb9d9b700 1 -- 172.21.15.106:0/273211355 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cbc0677d0 con 0x7f1cbc066dd0 2021-03-09T08:40:28.445 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cb9d9b700 1 -- 172.21.15.106:0/273211355 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563263917 0 0) 0x7f1cbc0a5de0 con 0x7f1cbc060d50 2021-03-09T08:40:28.446 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cb9d9b700 1 -- 172.21.15.106:0/273211355 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cbc061130 con 0x7f1cbc060d50 2021-03-09T08:40:28.446 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cb9d9b700 1 -- 172.21.15.106:0/273211355 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2731425566 0 0) 0x7f1c9c003230 con 0x7f1cbc0a2000 2021-03-09T08:40:28.446 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cb9d9b700 1 -- 172.21.15.106:0/273211355 >> v1:172.21.15.91:6790/0 conn(0x7f1cbc066dd0 legacy=0x7f1cbc0a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:28.446 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cb9d9b700 1 -- 172.21.15.106:0/273211355 >> v1:172.21.15.91:6789/0 conn(0x7f1cbc060d50 legacy=0x7f1cbc1353a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:28.447 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cb9d9b700 1 -- 172.21.15.106:0/273211355 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc0612c0 con 0x7f1cbc0a2000 2021-03-09T08:40:28.447 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cb9d9b700 1 -- 172.21.15.106:0/273211355 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f1cb4001a00 con 0x7f1cbc0a2000 2021-03-09T08:40:28.447 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cb9d9b700 1 -- 172.21.15.106:0/273211355 <== mon.1 v1:172.21.15.106:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1cb4001ce0 con 0x7f1cbc0a2000 2021-03-09T08:40:28.447 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cb9d9b700 1 -- 172.21.15.106:0/273211355 <== mon.1 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f1cb4002070 con 0x7f1cbc0a2000 2021-03-09T08:40:28.447 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cbb59e700 1 -- 172.21.15.106:0/273211355 >> v1:172.21.15.106:6789/0 conn(0x7f1cbc0a2000 legacy=0x7f1cbc141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:28.448 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cbb59e700 1 -- 172.21.15.106:0/273211355 shutdown_connections 2021-03-09T08:40:28.448 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cbb59e700 1 -- 172.21.15.106:0/273211355 >> 172.21.15.106:0/273211355 conn(0x7f1cbc0a9510 msgr2=0x7f1cbc0a98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:28.448 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cbb59e700 1 -- 172.21.15.106:0/273211355 shutdown_connections 2021-03-09T08:40:28.448 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.441+0000 7f1cbb59e700 1 -- 172.21.15.106:0/273211355 wait complete. 2021-03-09T08:40:28.451 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cbb59e700 1 Processor -- start 2021-03-09T08:40:28.452 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cbb59e700 1 -- start start 2021-03-09T08:40:28.452 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cbb59e700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc113100 con 0x7f1cbc0a2000 2021-03-09T08:40:28.453 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cbb59e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc112e30 con 0x7f1cbc060d50 2021-03-09T08:40:28.453 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cbb59e700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc1331d0 con 0x7f1cbc066dd0 2021-03-09T08:40:28.453 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cba59c700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1cbc060d50 0x7f1cbc111630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42182/0 (socket says 172.21.15.106:42182) 2021-03-09T08:40:28.454 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cba59c700 1 -- 172.21.15.106:0/261281551 learned_addr learned my addr 172.21.15.106:0/261281551 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-03-09T08:40:28.454 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419137127 0 0) 0x7f1cbc112e30 con 0x7f1cbc060d50 2021-03-09T08:40:28.454 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca0003230 con 0x7f1cbc060d50 2021-03-09T08:40:28.455 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3803508457 0 0) 0x7f1cbc1331d0 con 0x7f1cbc066dd0 2021-03-09T08:40:28.455 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cbc112e30 con 0x7f1cbc066dd0 2021-03-09T08:40:28.456 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200523338 0 0) 0x7f1cbc113100 con 0x7f1cbc0a2000 2021-03-09T08:40:28.456 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cbc1331d0 con 0x7f1cbc0a2000 2021-03-09T08:40:28.456 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 277745810 0 0) 0x7f1ca0003230 con 0x7f1cbc060d50 2021-03-09T08:40:28.457 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1cbc113100 con 0x7f1cbc060d50 2021-03-09T08:40:28.457 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f1ca40029b0 con 0x7f1cbc060d50 2021-03-09T08:40:28.457 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 <== mon.1 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1967872594 0 0) 0x7f1cbc113100 con 0x7f1cbc060d50 2021-03-09T08:40:28.457 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 >> v1:172.21.15.91:6790/0 conn(0x7f1cbc066dd0 legacy=0x7f1cbc139970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:28.458 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 >> v1:172.21.15.91:6789/0 conn(0x7f1cbc0a2000 legacy=0x7f1cbc14fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:28.458 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc13a080 con 0x7f1cbc060d50 2021-03-09T08:40:28.458 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cbb59e700 1 -- 172.21.15.106:0/261281551 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cbc1135a0 con 0x7f1cbc060d50 2021-03-09T08:40:28.458 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cbb59e700 1 -- 172.21.15.106:0/261281551 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cbc151450 con 0x7f1cbc060d50 2021-03-09T08:40:28.459 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 <== mon.1 v1:172.21.15.106:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1ca4002d40 con 0x7f1cbc060d50 2021-03-09T08:40:28.459 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 <== mon.1 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f1ca4001700 con 0x7f1cbc060d50 2021-03-09T08:40:28.459 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 <== mon.1 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7f1ca4001bc0 con 0x7f1cbc060d50 2021-03-09T08:40:28.460 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.445+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 <== mon.1 v1:172.21.15.106:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (unknown 4071554888 0 0) 0x7f1ca4006180 con 0x7f1cbc060d50 2021-03-09T08:40:28.460 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.449+0000 7f1cbb59e700 1 -- 172.21.15.106:0/261281551 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c94004d60 con 0x7f1cbc060d50 2021-03-09T08:40:28.461 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.449+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 <== mon.1 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (unknown 1092875540 0 637523725) 0x7f1ca40054d0 con 0x7f1cbc060d50 2021-03-09T08:40:28.534 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.533+0000 7f1cbb59e700 1 -- 172.21.15.106:0/261281551 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd new", "uuid": "d320711c-c382-48d3-bde9-d4787c3c1b58", "id": 0} v 0) v1 -- 0x7f1c94005590 con 0x7f1cbc060d50 2021-03-09T08:40:28.541 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.541+0000 7f1cb27fc700 1 -- 172.21.15.106:0/261281551 <== mon.1 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d320711c-c382-48d3-bde9-d4787c3c1b58", "id": 0}]=0 v3) v1 ==== 112+0+2 (unknown 2863935043 0 732707515) 0x7f1ca40056f0 con 0x7f1cbc060d50 2021-03-09T08:40:28.541 INFO:teuthology.orchestra.run.smithi106.stdout:0 2021-03-09T08:40:28.542 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.541+0000 7f1cbb59e700 1 -- 172.21.15.106:0/261281551 >> v1:172.21.15.106:6789/0 conn(0x7f1cbc060d50 legacy=0x7f1cbc111630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:28.543 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.541+0000 7f1cbb59e700 1 -- 172.21.15.106:0/261281551 shutdown_connections 2021-03-09T08:40:28.543 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.541+0000 7f1cbb59e700 1 -- 172.21.15.106:0/261281551 >> 172.21.15.106:0/261281551 conn(0x7f1cbc0a9510 msgr2=0x7f1cbc0664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:28.543 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.541+0000 7f1cbb59e700 1 -- 172.21.15.106:0/261281551 shutdown_connections 2021-03-09T08:40:28.543 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.541+0000 7f1cbb59e700 1 -- 172.21.15.106:0/261281551 wait complete. 2021-03-09T08:40:28.558 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 985e5655-b76d-408a-8029-06d21a1e4034 1 2021-03-09T08:40:28.743 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.741+0000 7fc905b02700 1 Processor -- start 2021-03-09T08:40:28.743 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.741+0000 7fc905b02700 1 -- start start 2021-03-09T08:40:28.746 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc905b02700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc900067380 con 0x7fc900062640 2021-03-09T08:40:28.746 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc905b02700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc900066e40 con 0x7fc900136190 2021-03-09T08:40:28.746 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc905b02700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc900136600 con 0x7fc900062260 2021-03-09T08:40:28.746 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc905301700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc900136190 0x7fc900135500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42192/0 (socket says 172.21.15.106:42192) 2021-03-09T08:40:28.747 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc905301700 1 -- 172.21.15.106:0/3713250876 learned_addr learned my addr 172.21.15.106:0/3713250876 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-03-09T08:40:28.747 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc8ff7fe700 1 -- 172.21.15.106:0/3713250876 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512805456 0 0) 0x7fc900066e40 con 0x7fc900136190 2021-03-09T08:40:28.747 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc8ff7fe700 1 -- 172.21.15.106:0/3713250876 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8e4003230 con 0x7fc900136190 2021-03-09T08:40:28.747 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc8ff7fe700 1 -- 172.21.15.106:0/3713250876 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 620947164 0 0) 0x7fc8e4003230 con 0x7fc900136190 2021-03-09T08:40:28.748 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc8ff7fe700 1 -- 172.21.15.106:0/3713250876 >> v1:172.21.15.91:6790/0 conn(0x7fc900062260 legacy=0x7fc9000631d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:28.748 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc8ff7fe700 1 -- 172.21.15.106:0/3713250876 >> v1:172.21.15.91:6789/0 conn(0x7fc900062640 legacy=0x7fc9000677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:28.748 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc8ff7fe700 1 -- 172.21.15.106:0/3713250876 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc900135c10 con 0x7fc900136190 2021-03-09T08:40:28.748 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc8ff7fe700 1 -- 172.21.15.106:0/3713250876 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fc8f8001a00 con 0x7fc900136190 2021-03-09T08:40:28.748 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc8ff7fe700 1 -- 172.21.15.106:0/3713250876 <== mon.1 v1:172.21.15.106:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc8f8001d20 con 0x7fc900136190 2021-03-09T08:40:28.749 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc8ff7fe700 1 -- 172.21.15.106:0/3713250876 <== mon.1 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fc8f80020b0 con 0x7fc900136190 2021-03-09T08:40:28.749 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc905b02700 1 -- 172.21.15.106:0/3713250876 >> v1:172.21.15.106:6789/0 conn(0x7fc900136190 legacy=0x7fc900135500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:28.749 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc905b02700 1 -- 172.21.15.106:0/3713250876 shutdown_connections 2021-03-09T08:40:28.749 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc905b02700 1 -- 172.21.15.106:0/3713250876 >> 172.21.15.106:0/3713250876 conn(0x7fc9000aa680 msgr2=0x7fc9000aaa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:28.749 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc905b02700 1 -- 172.21.15.106:0/3713250876 shutdown_connections 2021-03-09T08:40:28.751 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc905b02700 1 -- 172.21.15.106:0/3713250876 wait complete. 2021-03-09T08:40:28.753 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.745+0000 7fc905b02700 1 Processor -- start 2021-03-09T08:40:28.754 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc905b02700 1 -- start start 2021-03-09T08:40:28.754 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc905b02700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc900135920 con 0x7fc900062640 2021-03-09T08:40:28.754 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc905b02700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc900131410 con 0x7fc900136190 2021-03-09T08:40:28.755 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc905b02700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc900132f00 con 0x7fc900062260 2021-03-09T08:40:28.755 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc905301700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc900136190 0x7fc90014fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42198/0 (socket says 172.21.15.106:42198) 2021-03-09T08:40:28.755 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc905301700 1 -- 172.21.15.106:0/2088416822 learned_addr learned my addr 172.21.15.106:0/2088416822 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-03-09T08:40:28.755 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437482283 0 0) 0x7fc900131410 con 0x7fc900136190 2021-03-09T08:40:28.755 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8e0003230 con 0x7fc900136190 2021-03-09T08:40:28.756 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861670268 0 0) 0x7fc900132f00 con 0x7fc900062260 2021-03-09T08:40:28.756 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc900131410 con 0x7fc900062260 2021-03-09T08:40:28.756 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160275778 0 0) 0x7fc900135920 con 0x7fc900062640 2021-03-09T08:40:28.756 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc900132f00 con 0x7fc900062640 2021-03-09T08:40:28.757 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3186286834 0 0) 0x7fc8e0003230 con 0x7fc900136190 2021-03-09T08:40:28.757 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc900135920 con 0x7fc900136190 2021-03-09T08:40:28.757 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fc8f8002030 con 0x7fc900136190 2021-03-09T08:40:28.757 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 <== mon.2 v1:172.21.15.91:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3578335773 0 0) 0x7fc900131410 con 0x7fc900062260 2021-03-09T08:40:28.757 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 --> v1:172.21.15.91:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc8e0003230 con 0x7fc900062260 2021-03-09T08:40:28.758 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 <== mon.2 v1:172.21.15.91:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fc8f40018a0 con 0x7fc900062260 2021-03-09T08:40:28.758 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3556118797 0 0) 0x7fc900132f00 con 0x7fc900062640 2021-03-09T08:40:28.758 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 --> v1:172.21.15.91:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc900131410 con 0x7fc900062640 2021-03-09T08:40:28.758 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fc8ec001860 con 0x7fc900062640 2021-03-09T08:40:28.759 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 <== mon.1 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1883999007 0 0) 0x7fc900135920 con 0x7fc900136190 2021-03-09T08:40:28.759 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 >> v1:172.21.15.91:6790/0 conn(0x7fc900062260 legacy=0x7fc90012f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:28.759 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 >> v1:172.21.15.91:6789/0 conn(0x7fc900062640 legacy=0x7fc9001300f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:28.761 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc900133090 con 0x7fc900136190 2021-03-09T08:40:28.761 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc905b02700 1 -- 172.21.15.106:0/2088416822 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9001354d0 con 0x7fc900136190 2021-03-09T08:40:28.761 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc905b02700 1 -- 172.21.15.106:0/2088416822 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc900134bb0 con 0x7fc900136190 2021-03-09T08:40:28.761 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 <== mon.1 v1:172.21.15.106:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc8f8004d20 con 0x7fc900136190 2021-03-09T08:40:28.762 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 <== mon.1 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fc8f8004f10 con 0x7fc900136190 2021-03-09T08:40:28.762 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 <== mon.1 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7fc8f8005390 con 0x7fc900136190 2021-03-09T08:40:28.762 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 <== mon.1 v1:172.21.15.106:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (unknown 763867877 0 0) 0x7fc8f8006600 con 0x7fc900136190 2021-03-09T08:40:28.762 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.749+0000 7fc905b02700 1 -- 172.21.15.106:0/2088416822 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d8004d60 con 0x7fc900136190 2021-03-09T08:40:28.763 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.753+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 <== mon.1 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (unknown 1092875540 0 637523725) 0x7fc8f80068f0 con 0x7fc900136190 2021-03-09T08:40:28.840 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.841+0000 7fc905b02700 1 -- 172.21.15.106:0/2088416822 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd new", "uuid": "985e5655-b76d-408a-8029-06d21a1e4034", "id": 1} v 0) v1 -- 0x7fc8d8005010 con 0x7fc900136190 2021-03-09T08:40:28.852 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.849+0000 7fc8fcff9700 1 -- 172.21.15.106:0/2088416822 <== mon.1 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "985e5655-b76d-408a-8029-06d21a1e4034", "id": 1}]=0 v4) v1 ==== 112+0+2 (unknown 1981543896 0 940483276) 0x7fc8f8006b40 con 0x7fc900136190 2021-03-09T08:40:28.854 INFO:teuthology.orchestra.run.smithi106.stdout:1 2021-03-09T08:40:28.855 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.849+0000 7fc905b02700 1 -- 172.21.15.106:0/2088416822 >> v1:172.21.15.106:6789/0 conn(0x7fc900136190 legacy=0x7fc90014fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:28.855 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.849+0000 7fc905b02700 1 -- 172.21.15.106:0/2088416822 shutdown_connections 2021-03-09T08:40:28.856 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.849+0000 7fc905b02700 1 -- 172.21.15.106:0/2088416822 >> 172.21.15.106:0/2088416822 conn(0x7fc9000aa680 msgr2=0x7fc900139510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:28.856 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.849+0000 7fc905b02700 1 -- 172.21.15.106:0/2088416822 shutdown_connections 2021-03-09T08:40:28.856 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:28.849+0000 7fc905b02700 1 -- 172.21.15.106:0/2088416822 wait complete. 2021-03-09T08:40:28.870 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 9e2a9318-2469-4fbf-a6d9-2c8a5977839f 2 2021-03-09T08:40:29.053 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.053+0000 7f68cea1a700 1 Processor -- start 2021-03-09T08:40:29.054 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.053+0000 7f68cea1a700 1 -- start start 2021-03-09T08:40:29.060 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.053+0000 7f68cea1a700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c8138320 con 0x7f68c809d670 2021-03-09T08:40:29.061 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.053+0000 7f68cea1a700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c8134720 con 0x7f68c8133fa0 2021-03-09T08:40:29.061 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.053+0000 7f68cea1a700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c8134410 con 0x7f68c8134bc0 2021-03-09T08:40:29.061 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.053+0000 7f68ce219700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f68c8133fa0 0x7f68c8137c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42204/0 (socket says 172.21.15.106:42204) 2021-03-09T08:40:29.062 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.053+0000 7f68ce219700 1 -- 172.21.15.106:0/1561970503 learned_addr learned my addr 172.21.15.106:0/1561970503 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-03-09T08:40:29.062 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.053+0000 7f68cca16700 1 -- 172.21.15.106:0/1561970503 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138335403 0 0) 0x7f68c8134720 con 0x7f68c8133fa0 2021-03-09T08:40:29.062 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.053+0000 7f68cca16700 1 -- 172.21.15.106:0/1561970503 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68b0003230 con 0x7f68c8133fa0 2021-03-09T08:40:29.063 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.053+0000 7f68cca16700 1 -- 172.21.15.106:0/1561970503 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2378973390 0 0) 0x7f68b0003230 con 0x7f68c8133fa0 2021-03-09T08:40:29.063 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.053+0000 7f68cca16700 1 -- 172.21.15.106:0/1561970503 >> v1:172.21.15.91:6790/0 conn(0x7f68c8134bc0 legacy=0x7f68c8067c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.063 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.053+0000 7f68cca16700 1 -- 172.21.15.106:0/1561970503 >> v1:172.21.15.91:6789/0 conn(0x7f68c809d670 legacy=0x7f68c8137500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.063 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.053+0000 7f68cca16700 1 -- 172.21.15.106:0/1561970503 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c8066750 con 0x7f68c8133fa0 2021-03-09T08:40:29.064 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.053+0000 7f68cca16700 1 -- 172.21.15.106:0/1561970503 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f68c0001a00 con 0x7f68c8133fa0 2021-03-09T08:40:29.064 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68cca16700 1 -- 172.21.15.106:0/1561970503 <== mon.1 v1:172.21.15.106:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f68c0001c20 con 0x7f68c8133fa0 2021-03-09T08:40:29.065 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68cca16700 1 -- 172.21.15.106:0/1561970503 <== mon.1 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f68c0001fb0 con 0x7f68c8133fa0 2021-03-09T08:40:29.065 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68cea1a700 1 -- 172.21.15.106:0/1561970503 >> v1:172.21.15.106:6789/0 conn(0x7f68c8133fa0 legacy=0x7f68c8137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.065 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68cea1a700 1 -- 172.21.15.106:0/1561970503 shutdown_connections 2021-03-09T08:40:29.065 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68cea1a700 1 -- 172.21.15.106:0/1561970503 >> 172.21.15.106:0/1561970503 conn(0x7f68c80aa680 msgr2=0x7f68c80aaa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:29.066 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68cea1a700 1 -- 172.21.15.106:0/1561970503 shutdown_connections 2021-03-09T08:40:29.066 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68cea1a700 1 -- 172.21.15.106:0/1561970503 wait complete. 2021-03-09T08:40:29.066 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68cea1a700 1 Processor -- start 2021-03-09T08:40:29.066 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68cea1a700 1 -- start start 2021-03-09T08:40:29.067 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68cea1a700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c813d840 con 0x7f68c809d670 2021-03-09T08:40:29.067 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68cea1a700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c8063c40 con 0x7f68c8134bc0 2021-03-09T08:40:29.067 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68cea1a700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c813fb20 con 0x7f68c8133fa0 2021-03-09T08:40:29.068 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68ce219700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f68c8134bc0 0x7f68c81302b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42210/0 (socket says 172.21.15.106:42210) 2021-03-09T08:40:29.068 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68ce219700 1 -- 172.21.15.106:0/438740937 learned_addr learned my addr 172.21.15.106:0/438740937 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-03-09T08:40:29.068 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516076943 0 0) 0x7f68c8063c40 con 0x7f68c8134bc0 2021-03-09T08:40:29.069 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a8003230 con 0x7f68c8134bc0 2021-03-09T08:40:29.070 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373614137 0 0) 0x7f68c813d840 con 0x7f68c809d670 2021-03-09T08:40:29.070 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68c8063c40 con 0x7f68c809d670 2021-03-09T08:40:29.070 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402465193 0 0) 0x7f68c813fb20 con 0x7f68c8133fa0 2021-03-09T08:40:29.071 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68c813d840 con 0x7f68c8133fa0 2021-03-09T08:40:29.071 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4199307365 0 0) 0x7f68a8003230 con 0x7f68c8134bc0 2021-03-09T08:40:29.071 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f68c813fb20 con 0x7f68c8134bc0 2021-03-09T08:40:29.071 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f68c0001f30 con 0x7f68c8134bc0 2021-03-09T08:40:29.072 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3710563290 0 0) 0x7f68c8063c40 con 0x7f68c809d670 2021-03-09T08:40:29.072 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 --> v1:172.21.15.91:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f68a8003230 con 0x7f68c809d670 2021-03-09T08:40:29.072 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f68c4001810 con 0x7f68c809d670 2021-03-09T08:40:29.072 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 <== mon.1 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3351728732 0 0) 0x7f68c813fb20 con 0x7f68c8134bc0 2021-03-09T08:40:29.072 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 >> v1:172.21.15.91:6790/0 conn(0x7f68c8133fa0 legacy=0x7f68c813dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.073 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 >> v1:172.21.15.91:6789/0 conn(0x7f68c809d670 legacy=0x7f68c813d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.073 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c813fcb0 con 0x7f68c8134bc0 2021-03-09T08:40:29.073 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68cea1a700 1 -- 172.21.15.106:0/438740937 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c81309c0 con 0x7f68c8134bc0 2021-03-09T08:40:29.073 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.057+0000 7f68cea1a700 1 -- 172.21.15.106:0/438740937 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c8130e10 con 0x7f68c8134bc0 2021-03-09T08:40:29.074 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.061+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 <== mon.1 v1:172.21.15.106:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f68c00015e0 con 0x7f68c8134bc0 2021-03-09T08:40:29.074 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.061+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 <== mon.1 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f68c0004ea0 con 0x7f68c8134bc0 2021-03-09T08:40:29.074 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.061+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 <== mon.1 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7f68c0005360 con 0x7f68c8134bc0 2021-03-09T08:40:29.074 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.061+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 <== mon.1 v1:172.21.15.106:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (unknown 2291182304 0 0) 0x7f68c00066d0 con 0x7f68c8134bc0 2021-03-09T08:40:29.075 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.061+0000 7f68cea1a700 1 -- 172.21.15.106:0/438740937 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a4004d60 con 0x7f68c8134bc0 2021-03-09T08:40:29.075 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.065+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 <== mon.1 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (unknown 1092875540 0 637523725) 0x7f68c0006b30 con 0x7f68c8134bc0 2021-03-09T08:40:29.147 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.145+0000 7f68cea1a700 1 -- 172.21.15.106:0/438740937 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd new", "uuid": "9e2a9318-2469-4fbf-a6d9-2c8a5977839f", "id": 2} v 0) v1 -- 0x7f68a4005590 con 0x7f68c8134bc0 2021-03-09T08:40:29.157 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.157+0000 7f68b5ffb700 1 -- 172.21.15.106:0/438740937 <== mon.1 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9e2a9318-2469-4fbf-a6d9-2c8a5977839f", "id": 2}]=0 v5) v1 ==== 112+0+2 (unknown 1884675452 0 216599125) 0x7f68c00061d0 con 0x7f68c8134bc0 2021-03-09T08:40:29.157 INFO:teuthology.orchestra.run.smithi106.stdout:2 2021-03-09T08:40:29.159 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.157+0000 7f68cea1a700 1 -- 172.21.15.106:0/438740937 >> v1:172.21.15.106:6789/0 conn(0x7f68c8134bc0 legacy=0x7f68c81302b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.159 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.157+0000 7f68cea1a700 1 -- 172.21.15.106:0/438740937 shutdown_connections 2021-03-09T08:40:29.159 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.157+0000 7f68cea1a700 1 -- 172.21.15.106:0/438740937 >> 172.21.15.106:0/438740937 conn(0x7f68c80aa680 msgr2=0x7f68c80a7550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:29.159 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.157+0000 7f68cea1a700 1 -- 172.21.15.106:0/438740937 shutdown_connections 2021-03-09T08:40:29.160 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.157+0000 7f68cea1a700 1 -- 172.21.15.106:0/438740937 wait complete. 2021-03-09T08:40:29.175 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new f8d9be67-32be-4716-a240-d768d5a50465 3 2021-03-09T08:40:29.351 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe3a5683700 1 Processor -- start 2021-03-09T08:40:29.352 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe3a5683700 1 -- start start 2021-03-09T08:40:29.354 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe3a5683700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a00622e0 con 0x7fe3a009eac0 2021-03-09T08:40:29.355 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe3a5683700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a009efd0 con 0x7fe3a009d4e0 2021-03-09T08:40:29.355 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe3a5683700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a00a4d40 con 0x7fe3a0061f00 2021-03-09T08:40:29.355 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe39f7fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe3a009d4e0 0x7fe3a0067fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42214/0 (socket says 172.21.15.106:42214) 2021-03-09T08:40:29.355 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe39f7fe700 1 -- 172.21.15.106:0/3868277740 learned_addr learned my addr 172.21.15.106:0/3868277740 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-03-09T08:40:29.356 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe39effd700 1 -- 172.21.15.106:0/3868277740 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821668988 0 0) 0x7fe3a009efd0 con 0x7fe3a009d4e0 2021-03-09T08:40:29.356 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe39effd700 1 -- 172.21.15.106:0/3868277740 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe380003230 con 0x7fe3a009d4e0 2021-03-09T08:40:29.356 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe39effd700 1 -- 172.21.15.106:0/3868277740 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223256168 0 0) 0x7fe3a00a4d40 con 0x7fe3a0061f00 2021-03-09T08:40:29.356 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe39effd700 1 -- 172.21.15.106:0/3868277740 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3a009efd0 con 0x7fe3a0061f00 2021-03-09T08:40:29.357 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe39effd700 1 -- 172.21.15.106:0/3868277740 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2551199127 0 0) 0x7fe380003230 con 0x7fe3a009d4e0 2021-03-09T08:40:29.357 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe39effd700 1 -- 172.21.15.106:0/3868277740 >> v1:172.21.15.91:6790/0 conn(0x7fe3a0061f00 legacy=0x7fe3a01361b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.357 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe39effd700 1 -- 172.21.15.106:0/3868277740 >> v1:172.21.15.91:6789/0 conn(0x7fe3a009eac0 legacy=0x7fe3a0141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.357 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe39effd700 1 -- 172.21.15.106:0/3868277740 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a009f470 con 0x7fe3a009d4e0 2021-03-09T08:40:29.357 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe39effd700 1 -- 172.21.15.106:0/3868277740 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fe388001680 con 0x7fe3a009d4e0 2021-03-09T08:40:29.358 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe39effd700 1 -- 172.21.15.106:0/3868277740 <== mon.1 v1:172.21.15.106:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe388001960 con 0x7fe3a009d4e0 2021-03-09T08:40:29.358 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe39effd700 1 -- 172.21.15.106:0/3868277740 <== mon.1 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fe388001cf0 con 0x7fe3a009d4e0 2021-03-09T08:40:29.358 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe3a5683700 1 -- 172.21.15.106:0/3868277740 >> v1:172.21.15.106:6789/0 conn(0x7fe3a009d4e0 legacy=0x7fe3a0067fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.358 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe3a5683700 1 -- 172.21.15.106:0/3868277740 shutdown_connections 2021-03-09T08:40:29.359 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe3a5683700 1 -- 172.21.15.106:0/3868277740 >> 172.21.15.106:0/3868277740 conn(0x7fe3a00a9750 msgr2=0x7fe3a00a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:29.359 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe3a5683700 1 -- 172.21.15.106:0/3868277740 shutdown_connections 2021-03-09T08:40:29.359 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe3a5683700 1 -- 172.21.15.106:0/3868277740 wait complete. 2021-03-09T08:40:29.359 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.353+0000 7fe3a5683700 1 Processor -- start 2021-03-09T08:40:29.359 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe3a5683700 1 -- start start 2021-03-09T08:40:29.364 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe3a5683700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a00a2fc0 con 0x7fe3a009d4e0 2021-03-09T08:40:29.364 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe3a5683700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a0146190 con 0x7fe3a009eac0 2021-03-09T08:40:29.365 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe3a5683700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a0145ec0 con 0x7fe3a0061f00 2021-03-09T08:40:29.365 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe3a4e82700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe3a009eac0 0x7fe3a00a0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42220/0 (socket says 172.21.15.106:42220) 2021-03-09T08:40:29.365 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe3a4e82700 1 -- 172.21.15.106:0/1585906247 learned_addr learned my addr 172.21.15.106:0/1585906247 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-03-09T08:40:29.365 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734754151 0 0) 0x7fe3a0146190 con 0x7fe3a009eac0 2021-03-09T08:40:29.365 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe384003230 con 0x7fe3a009eac0 2021-03-09T08:40:29.366 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377108317 0 0) 0x7fe3a00a2fc0 con 0x7fe3a009d4e0 2021-03-09T08:40:29.366 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3a0146190 con 0x7fe3a009d4e0 2021-03-09T08:40:29.366 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346536203 0 0) 0x7fe3a0145ec0 con 0x7fe3a0061f00 2021-03-09T08:40:29.366 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3a00a2fc0 con 0x7fe3a0061f00 2021-03-09T08:40:29.367 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2468016291 0 0) 0x7fe384003230 con 0x7fe3a009eac0 2021-03-09T08:40:29.367 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe3a0145ec0 con 0x7fe3a009eac0 2021-03-09T08:40:29.367 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fe390001950 con 0x7fe3a009eac0 2021-03-09T08:40:29.367 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2614137334 0 0) 0x7fe3a0146190 con 0x7fe3a009d4e0 2021-03-09T08:40:29.367 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 --> v1:172.21.15.91:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe384003230 con 0x7fe3a009d4e0 2021-03-09T08:40:29.368 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fe388001ad0 con 0x7fe3a009d4e0 2021-03-09T08:40:29.368 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 <== mon.1 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 111680666 0 0) 0x7fe3a0145ec0 con 0x7fe3a009eac0 2021-03-09T08:40:29.368 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 >> v1:172.21.15.91:6790/0 conn(0x7fe3a0061f00 legacy=0x7fe3a0114d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.368 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 >> v1:172.21.15.91:6789/0 conn(0x7fe3a009d4e0 legacy=0x7fe3a0066aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.369 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a0135ce0 con 0x7fe3a009eac0 2021-03-09T08:40:29.369 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe3a5683700 1 -- 172.21.15.106:0/1585906247 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a0067840 con 0x7fe3a009eac0 2021-03-09T08:40:29.369 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe3a5683700 1 -- 172.21.15.106:0/1585906247 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a0146630 con 0x7fe3a009eac0 2021-03-09T08:40:29.369 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 <== mon.1 v1:172.21.15.106:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe390001c90 con 0x7fe3a009eac0 2021-03-09T08:40:29.369 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe3a5683700 1 -- 172.21.15.106:0/1585906247 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a00589b0 con 0x7fe3a009eac0 2021-03-09T08:40:29.370 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 <== mon.1 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fe390002360 con 0x7fe3a009eac0 2021-03-09T08:40:29.370 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 <== mon.1 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7fe3900027a0 con 0x7fe3a009eac0 2021-03-09T08:40:29.370 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.357+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 <== mon.1 v1:172.21.15.106:6789/0 8 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (unknown 1056616575 0 0) 0x7fe390006020 con 0x7fe3a009eac0 2021-03-09T08:40:29.370 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.361+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 <== mon.1 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (unknown 1092875540 0 637523725) 0x7fe390005520 con 0x7fe3a009eac0 2021-03-09T08:40:29.438 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.437+0000 7fe3a5683700 1 -- 172.21.15.106:0/1585906247 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd new", "uuid": "f8d9be67-32be-4716-a240-d768d5a50465", "id": 3} v 0) v1 -- 0x7fe3a00a61d0 con 0x7fe3a009eac0 2021-03-09T08:40:29.447 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.449+0000 7fe397fff700 1 -- 172.21.15.106:0/1585906247 <== mon.1 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f8d9be67-32be-4716-a240-d768d5a50465", "id": 3}]=0 v6) v1 ==== 112+0+2 (unknown 1109761341 0 525046306) 0x7fe390005c10 con 0x7fe3a009eac0 2021-03-09T08:40:29.448 INFO:teuthology.orchestra.run.smithi106.stdout:3 2021-03-09T08:40:29.449 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.449+0000 7fe3a5683700 1 -- 172.21.15.106:0/1585906247 >> v1:172.21.15.106:6789/0 conn(0x7fe3a009eac0 legacy=0x7fe3a00a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.449 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.449+0000 7fe3a5683700 1 -- 172.21.15.106:0/1585906247 shutdown_connections 2021-03-09T08:40:29.450 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.449+0000 7fe3a5683700 1 -- 172.21.15.106:0/1585906247 >> 172.21.15.106:0/1585906247 conn(0x7fe3a00a9750 msgr2=0x7fe3a005cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:29.450 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.449+0000 7fe3a5683700 1 -- 172.21.15.106:0/1585906247 shutdown_connections 2021-03-09T08:40:29.451 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.449+0000 7fe3a5683700 1 -- 172.21.15.106:0/1585906247 wait complete. 2021-03-09T08:40:29.466 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 23c43fc1-8b3e-4e3b-b710-a638544f04fb 4 2021-03-09T08:40:29.631 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.629+0000 7f0982467700 1 Processor -- start 2021-03-09T08:40:29.631 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.629+0000 7f0982467700 1 -- start start 2021-03-09T08:40:29.635 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f0982467700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097c09d820 con 0x7f097c09dcc0 2021-03-09T08:40:29.635 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f0982467700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097c133a90 con 0x7f097c133d00 2021-03-09T08:40:29.635 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f0982467700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097c0a5cb0 con 0x7f097c060d50 2021-03-09T08:40:29.636 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f0981c66700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f097c133d00 0x7f097c13f610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42226/0 (socket says 172.21.15.106:42226) 2021-03-09T08:40:29.636 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f0981c66700 1 -- 172.21.15.106:0/1873696579 learned_addr learned my addr 172.21.15.106:0/1873696579 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-03-09T08:40:29.636 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f096bfff700 1 -- 172.21.15.106:0/1873696579 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727563127 0 0) 0x7f097c133a90 con 0x7f097c133d00 2021-03-09T08:40:29.637 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f096bfff700 1 -- 172.21.15.106:0/1873696579 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0964003230 con 0x7f097c133d00 2021-03-09T08:40:29.637 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f096bfff700 1 -- 172.21.15.106:0/1873696579 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521856221 0 0) 0x7f097c0a5cb0 con 0x7f097c060d50 2021-03-09T08:40:29.637 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f096bfff700 1 -- 172.21.15.106:0/1873696579 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f097c133a90 con 0x7f097c060d50 2021-03-09T08:40:29.637 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f096bfff700 1 -- 172.21.15.106:0/1873696579 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123451464 0 0) 0x7f097c09d820 con 0x7f097c09dcc0 2021-03-09T08:40:29.638 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f096bfff700 1 -- 172.21.15.106:0/1873696579 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f097c0a5cb0 con 0x7f097c09dcc0 2021-03-09T08:40:29.638 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f096bfff700 1 -- 172.21.15.106:0/1873696579 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1161130920 0 0) 0x7f0964003230 con 0x7f097c133d00 2021-03-09T08:40:29.638 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f096bfff700 1 -- 172.21.15.106:0/1873696579 >> v1:172.21.15.91:6790/0 conn(0x7f097c060d50 legacy=0x7f097c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.638 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f096bfff700 1 -- 172.21.15.106:0/1873696579 >> v1:172.21.15.91:6789/0 conn(0x7f097c09dcc0 legacy=0x7f097c133380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.638 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f096bfff700 1 -- 172.21.15.106:0/1873696579 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c09d4e0 con 0x7f097c133d00 2021-03-09T08:40:29.639 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f096bfff700 1 -- 172.21.15.106:0/1873696579 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f0974001a00 con 0x7f097c133d00 2021-03-09T08:40:29.639 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f096bfff700 1 -- 172.21.15.106:0/1873696579 <== mon.1 v1:172.21.15.106:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0974001ce0 con 0x7f097c133d00 2021-03-09T08:40:29.639 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f096bfff700 1 -- 172.21.15.106:0/1873696579 <== mon.1 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f0974002070 con 0x7f097c133d00 2021-03-09T08:40:29.640 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f0982467700 1 -- 172.21.15.106:0/1873696579 >> v1:172.21.15.106:6789/0 conn(0x7f097c133d00 legacy=0x7f097c13f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.640 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f0982467700 1 -- 172.21.15.106:0/1873696579 shutdown_connections 2021-03-09T08:40:29.640 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f0982467700 1 -- 172.21.15.106:0/1873696579 >> 172.21.15.106:0/1873696579 conn(0x7f097c0a9510 msgr2=0x7f097c0a98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:29.640 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f0982467700 1 -- 172.21.15.106:0/1873696579 shutdown_connections 2021-03-09T08:40:29.641 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.633+0000 7f0982467700 1 -- 172.21.15.106:0/1873696579 wait complete. 2021-03-09T08:40:29.641 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f0982467700 1 Processor -- start 2021-03-09T08:40:29.641 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f0982467700 1 -- start start 2021-03-09T08:40:29.646 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f0982467700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097c137120 con 0x7f097c060d50 2021-03-09T08:40:29.647 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f0982467700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097c0a50b0 con 0x7f097c133d00 2021-03-09T08:40:29.647 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f0982467700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097c12da30 con 0x7f097c09dcc0 2021-03-09T08:40:29.647 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f0981c66700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f097c133d00 0x7f097c1389d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42234/0 (socket says 172.21.15.106:42234) 2021-03-09T08:40:29.647 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f0981c66700 1 -- 172.21.15.106:0/2156525767 learned_addr learned my addr 172.21.15.106:0/2156525767 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-03-09T08:40:29.648 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373603393 0 0) 0x7f097c0a50b0 con 0x7f097c133d00 2021-03-09T08:40:29.648 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f095c003230 con 0x7f097c133d00 2021-03-09T08:40:29.648 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275776204 0 0) 0x7f097c137120 con 0x7f097c060d50 2021-03-09T08:40:29.648 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f097c0a50b0 con 0x7f097c060d50 2021-03-09T08:40:29.649 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680086369 0 0) 0x7f097c12da30 con 0x7f097c09dcc0 2021-03-09T08:40:29.649 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f097c137120 con 0x7f097c09dcc0 2021-03-09T08:40:29.649 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2050376992 0 0) 0x7f095c003230 con 0x7f097c133d00 2021-03-09T08:40:29.649 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f097c12da30 con 0x7f097c133d00 2021-03-09T08:40:29.649 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f0974002030 con 0x7f097c133d00 2021-03-09T08:40:29.650 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 <== mon.2 v1:172.21.15.91:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2564268550 0 0) 0x7f097c137120 con 0x7f097c09dcc0 2021-03-09T08:40:29.650 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 --> v1:172.21.15.91:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f095c003230 con 0x7f097c09dcc0 2021-03-09T08:40:29.650 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 <== mon.2 v1:172.21.15.91:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f096c0018e0 con 0x7f097c09dcc0 2021-03-09T08:40:29.650 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1936376584 0 0) 0x7f097c0a50b0 con 0x7f097c060d50 2021-03-09T08:40:29.650 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 --> v1:172.21.15.91:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f097c137120 con 0x7f097c060d50 2021-03-09T08:40:29.651 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f09780018e0 con 0x7f097c060d50 2021-03-09T08:40:29.651 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 <== mon.1 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4106483359 0 0) 0x7f097c12da30 con 0x7f097c133d00 2021-03-09T08:40:29.651 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 >> v1:172.21.15.91:6790/0 conn(0x7f097c09dcc0 legacy=0x7f097c0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.651 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 >> v1:172.21.15.91:6789/0 conn(0x7f097c060d50 legacy=0x7f097c12d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.652 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c12dbc0 con 0x7f097c133d00 2021-03-09T08:40:29.652 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f0982467700 1 -- 172.21.15.106:0/2156525767 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097c136a40 con 0x7f097c133d00 2021-03-09T08:40:29.652 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f0982467700 1 -- 172.21.15.106:0/2156525767 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f097c0a12d0 con 0x7f097c133d00 2021-03-09T08:40:29.652 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 <== mon.1 v1:172.21.15.106:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0974001550 con 0x7f097c133d00 2021-03-09T08:40:29.652 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 <== mon.1 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f0974004d00 con 0x7f097c133d00 2021-03-09T08:40:29.653 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 <== mon.1 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7f09740051c0 con 0x7f097c133d00 2021-03-09T08:40:29.653 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 <== mon.1 v1:172.21.15.106:6789/0 8 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (unknown 855569091 0 0) 0x7f0974005980 con 0x7f097c133d00 2021-03-09T08:40:29.653 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.637+0000 7f0982467700 1 -- 172.21.15.106:0/2156525767 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0954004d60 con 0x7f097c133d00 2021-03-09T08:40:29.653 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.641+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 <== mon.1 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (unknown 1092875540 0 637523725) 0x7f0974005450 con 0x7f097c133d00 2021-03-09T08:40:29.723 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.721+0000 7f0982467700 1 -- 172.21.15.106:0/2156525767 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd new", "uuid": "23c43fc1-8b3e-4e3b-b710-a638544f04fb", "id": 4} v 0) v1 -- 0x7f0954005590 con 0x7f097c133d00 2021-03-09T08:40:29.729 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.729+0000 7f09697fa700 1 -- 172.21.15.106:0/2156525767 <== mon.1 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23c43fc1-8b3e-4e3b-b710-a638544f04fb", "id": 4}]=0 v7) v1 ==== 112+0+2 (unknown 733921504 0 1697012583) 0x7f0974005750 con 0x7f097c133d00 2021-03-09T08:40:29.730 INFO:teuthology.orchestra.run.smithi106.stdout:4 2021-03-09T08:40:29.731 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.729+0000 7f0982467700 1 -- 172.21.15.106:0/2156525767 >> v1:172.21.15.106:6789/0 conn(0x7f097c133d00 legacy=0x7f097c1389d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.731 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.729+0000 7f0982467700 1 -- 172.21.15.106:0/2156525767 shutdown_connections 2021-03-09T08:40:29.731 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.729+0000 7f0982467700 1 -- 172.21.15.106:0/2156525767 >> 172.21.15.106:0/2156525767 conn(0x7f097c0a9510 msgr2=0x7f097c061b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:29.731 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.729+0000 7f0982467700 1 -- 172.21.15.106:0/2156525767 shutdown_connections 2021-03-09T08:40:29.731 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.729+0000 7f0982467700 1 -- 172.21.15.106:0/2156525767 wait complete. 2021-03-09T08:40:29.747 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 8ced66cb-bff4-4e6d-bbdb-825f34496f8f 5 2021-03-09T08:40:29.914 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.913+0000 7fe8a6a36700 1 Processor -- start 2021-03-09T08:40:29.915 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.913+0000 7fe8a6a36700 1 -- start start 2021-03-09T08:40:29.916 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a6a36700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a00a0100 con 0x7fe8a0061f00 2021-03-09T08:40:29.916 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a6a36700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a00622e0 con 0x7fe8a009de00 2021-03-09T08:40:29.916 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a6a36700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a00a0330 con 0x7fe8a013b0a0 2021-03-09T08:40:29.916 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a5233700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe8a009de00 0x7fe8a00a0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42238/0 (socket says 172.21.15.106:42238) 2021-03-09T08:40:29.917 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a5233700 1 -- 172.21.15.106:0/1136395860 learned_addr learned my addr 172.21.15.106:0/1136395860 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-03-09T08:40:29.919 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a4a32700 1 -- 172.21.15.106:0/1136395860 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308011526 0 0) 0x7fe8a00622e0 con 0x7fe8a009de00 2021-03-09T08:40:29.919 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a4a32700 1 -- 172.21.15.106:0/1136395860 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe888003230 con 0x7fe8a009de00 2021-03-09T08:40:29.919 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a4a32700 1 -- 172.21.15.106:0/1136395860 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049640410 0 0) 0x7fe8a00a0100 con 0x7fe8a0061f00 2021-03-09T08:40:29.919 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a4a32700 1 -- 172.21.15.106:0/1136395860 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a00622e0 con 0x7fe8a0061f00 2021-03-09T08:40:29.919 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a4a32700 1 -- 172.21.15.106:0/1136395860 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658584924 0 0) 0x7fe8a00a0330 con 0x7fe8a013b0a0 2021-03-09T08:40:29.920 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a4a32700 1 -- 172.21.15.106:0/1136395860 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a00a0100 con 0x7fe8a013b0a0 2021-03-09T08:40:29.920 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a4a32700 1 -- 172.21.15.106:0/1136395860 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3032099388 0 0) 0x7fe888003230 con 0x7fe8a009de00 2021-03-09T08:40:29.920 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a4a32700 1 -- 172.21.15.106:0/1136395860 >> v1:172.21.15.91:6790/0 conn(0x7fe8a013b0a0 legacy=0x7fe8a013d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.920 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a4a32700 1 -- 172.21.15.106:0/1136395860 >> v1:172.21.15.91:6789/0 conn(0x7fe8a0061f00 legacy=0x7fe8a00a5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.921 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a4a32700 1 -- 172.21.15.106:0/1136395860 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a009f9b0 con 0x7fe8a009de00 2021-03-09T08:40:29.921 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a4a32700 1 -- 172.21.15.106:0/1136395860 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fe890001600 con 0x7fe8a009de00 2021-03-09T08:40:29.921 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a4a32700 1 -- 172.21.15.106:0/1136395860 <== mon.1 v1:172.21.15.106:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe890001820 con 0x7fe8a009de00 2021-03-09T08:40:29.921 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a4a32700 1 -- 172.21.15.106:0/1136395860 <== mon.1 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fe890001bb0 con 0x7fe8a009de00 2021-03-09T08:40:29.921 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a6a36700 1 -- 172.21.15.106:0/1136395860 >> v1:172.21.15.106:6789/0 conn(0x7fe8a009de00 legacy=0x7fe8a00a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.922 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a6a36700 1 -- 172.21.15.106:0/1136395860 shutdown_connections 2021-03-09T08:40:29.922 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a6a36700 1 -- 172.21.15.106:0/1136395860 >> 172.21.15.106:0/1136395860 conn(0x7fe8a00a9750 msgr2=0x7fe8a00a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:29.922 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a6a36700 1 -- 172.21.15.106:0/1136395860 shutdown_connections 2021-03-09T08:40:29.922 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.917+0000 7fe8a6a36700 1 -- 172.21.15.106:0/1136395860 wait complete. 2021-03-09T08:40:29.925 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe8a6a36700 1 Processor -- start 2021-03-09T08:40:29.926 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe8a6a36700 1 -- start start 2021-03-09T08:40:29.926 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe8a6a36700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a012ec00 con 0x7fe8a013b0a0 2021-03-09T08:40:29.926 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe8a6a36700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a012ed90 con 0x7fe8a0061f00 2021-03-09T08:40:29.927 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe8a6a36700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a012f750 con 0x7fe8a009de00 2021-03-09T08:40:29.927 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe8a5a34700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe8a0061f00 0x7fe8a0143760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42242/0 (socket says 172.21.15.106:42242) 2021-03-09T08:40:29.927 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe8a5a34700 1 -- 172.21.15.106:0/3459926532 learned_addr learned my addr 172.21.15.106:0/3459926532 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-03-09T08:40:29.928 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392362296 0 0) 0x7fe8a012ed90 con 0x7fe8a0061f00 2021-03-09T08:40:29.928 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe880003230 con 0x7fe8a0061f00 2021-03-09T08:40:29.928 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654723516 0 0) 0x7fe8a012f750 con 0x7fe8a009de00 2021-03-09T08:40:29.928 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a012ed90 con 0x7fe8a009de00 2021-03-09T08:40:29.929 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1417054751 0 0) 0x7fe880003230 con 0x7fe8a0061f00 2021-03-09T08:40:29.929 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe8a012f750 con 0x7fe8a0061f00 2021-03-09T08:40:29.929 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460947273 0 0) 0x7fe8a012ec00 con 0x7fe8a013b0a0 2021-03-09T08:40:29.929 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe880003230 con 0x7fe8a013b0a0 2021-03-09T08:40:29.930 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fe89c002a30 con 0x7fe8a0061f00 2021-03-09T08:40:29.930 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 <== mon.1 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1906477106 0 0) 0x7fe8a012f750 con 0x7fe8a0061f00 2021-03-09T08:40:29.930 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 >> v1:172.21.15.91:6790/0 conn(0x7fe8a009de00 legacy=0x7fe8a012e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.930 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 >> v1:172.21.15.91:6789/0 conn(0x7fe8a013b0a0 legacy=0x7fe8a014e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:29.931 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a012f8e0 con 0x7fe8a0061f00 2021-03-09T08:40:29.931 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe8a6a36700 1 -- 172.21.15.106:0/3459926532 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a01443c0 con 0x7fe8a0061f00 2021-03-09T08:40:29.931 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe8a6a36700 1 -- 172.21.15.106:0/3459926532 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a01311b0 con 0x7fe8a0061f00 2021-03-09T08:40:29.931 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 <== mon.1 v1:172.21.15.106:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe89c002c60 con 0x7fe8a0061f00 2021-03-09T08:40:29.932 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 <== mon.1 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fe89c001800 con 0x7fe8a0061f00 2021-03-09T08:40:29.932 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 <== mon.1 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7fe89c001cc0 con 0x7fe8a0061f00 2021-03-09T08:40:29.932 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 <== mon.1 v1:172.21.15.106:6789/0 8 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (unknown 2008360767 0 0) 0x7fe89c006310 con 0x7fe8a0061f00 2021-03-09T08:40:29.932 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.921+0000 7fe8a6a36700 1 -- 172.21.15.106:0/3459926532 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe87c004d60 con 0x7fe8a0061f00 2021-03-09T08:40:29.933 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:29.925+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 <== mon.1 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (unknown 1092875540 0 637523725) 0x7fe89c0054d0 con 0x7fe8a0061f00 2021-03-09T08:40:30.012 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.013+0000 7fe8a6a36700 1 -- 172.21.15.106:0/3459926532 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd new", "uuid": "8ced66cb-bff4-4e6d-bbdb-825f34496f8f", "id": 5} v 0) v1 -- 0x7fe87c005590 con 0x7fe8a0061f00 2021-03-09T08:40:30.017 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.017+0000 7fe88dffb700 1 -- 172.21.15.106:0/3459926532 <== mon.1 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8ced66cb-bff4-4e6d-bbdb-825f34496f8f", "id": 5}]=0 v8) v1 ==== 112+0+2 (unknown 1167496489 0 1988412176) 0x7fe89c005750 con 0x7fe8a0061f00 2021-03-09T08:40:30.018 INFO:teuthology.orchestra.run.smithi106.stdout:5 2021-03-09T08:40:30.019 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.017+0000 7fe8a6a36700 1 -- 172.21.15.106:0/3459926532 >> v1:172.21.15.106:6789/0 conn(0x7fe8a0061f00 legacy=0x7fe8a0143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:30.019 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.017+0000 7fe8a6a36700 1 -- 172.21.15.106:0/3459926532 shutdown_connections 2021-03-09T08:40:30.020 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.017+0000 7fe8a6a36700 1 -- 172.21.15.106:0/3459926532 >> 172.21.15.106:0/3459926532 conn(0x7fe8a00a9750 msgr2=0x7fe8a00a5710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:30.020 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.017+0000 7fe8a6a36700 1 -- 172.21.15.106:0/3459926532 shutdown_connections 2021-03-09T08:40:30.020 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.017+0000 7fe8a6a36700 1 -- 172.21.15.106:0/3459926532 wait complete. 2021-03-09T08:40:30.035 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new e5ffeaee-5262-41b6-b548-5d1a476feaaf 6 2021-03-09T08:40:30.205 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.205+0000 7f172dede700 1 Processor -- start 2021-03-09T08:40:30.206 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.205+0000 7f172dede700 1 -- start start 2021-03-09T08:40:30.208 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.205+0000 7f172dede700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17280ad460 con 0x7f17281395d0 2021-03-09T08:40:30.208 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.205+0000 7f172dede700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1728063e70 con 0x7f172812f800 2021-03-09T08:40:30.208 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.205+0000 7f172dede700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17280a2040 con 0x7f17280ad080 2021-03-09T08:40:30.209 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.205+0000 7f1726ffd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f172812f800 0x7f172812fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42248/0 (socket says 172.21.15.106:42248) 2021-03-09T08:40:30.209 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.205+0000 7f1726ffd700 1 -- 172.21.15.106:0/1086693993 learned_addr learned my addr 172.21.15.106:0/1086693993 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-03-09T08:40:30.209 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.205+0000 7f17267fc700 1 -- 172.21.15.106:0/1086693993 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263128073 0 0) 0x7f1728063e70 con 0x7f172812f800 2021-03-09T08:40:30.209 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.205+0000 7f17267fc700 1 -- 172.21.15.106:0/1086693993 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1708003230 con 0x7f172812f800 2021-03-09T08:40:30.210 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.205+0000 7f17267fc700 1 -- 172.21.15.106:0/1086693993 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1773421867 0 0) 0x7f1708003230 con 0x7f172812f800 2021-03-09T08:40:30.210 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.205+0000 7f17267fc700 1 -- 172.21.15.106:0/1086693993 >> v1:172.21.15.91:6790/0 conn(0x7f17280ad080 legacy=0x7f17280a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:30.210 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.205+0000 7f17267fc700 1 -- 172.21.15.106:0/1086693993 >> v1:172.21.15.91:6789/0 conn(0x7f17281395d0 legacy=0x7f17281399f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:30.210 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.205+0000 7f17267fc700 1 -- 172.21.15.106:0/1086693993 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17280a1cf0 con 0x7f172812f800 2021-03-09T08:40:30.211 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.205+0000 7f17267fc700 1 -- 172.21.15.106:0/1086693993 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f1710001680 con 0x7f172812f800 2021-03-09T08:40:30.211 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.205+0000 7f17267fc700 1 -- 172.21.15.106:0/1086693993 <== mon.1 v1:172.21.15.106:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f17100019a0 con 0x7f172812f800 2021-03-09T08:40:30.211 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.205+0000 7f17267fc700 1 -- 172.21.15.106:0/1086693993 <== mon.1 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f17100045b0 con 0x7f172812f800 2021-03-09T08:40:30.211 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.209+0000 7f172dede700 1 -- 172.21.15.106:0/1086693993 >> v1:172.21.15.106:6789/0 conn(0x7f172812f800 legacy=0x7f172812fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:30.212 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.209+0000 7f172dede700 1 -- 172.21.15.106:0/1086693993 shutdown_connections 2021-03-09T08:40:30.212 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.209+0000 7f172dede700 1 -- 172.21.15.106:0/1086693993 >> 172.21.15.106:0/1086693993 conn(0x7f1728061810 msgr2=0x7f17280ac7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:30.212 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.209+0000 7f172dede700 1 -- 172.21.15.106:0/1086693993 shutdown_connections 2021-03-09T08:40:30.212 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.209+0000 7f172dede700 1 -- 172.21.15.106:0/1086693993 wait complete. 2021-03-09T08:40:30.216 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.209+0000 7f172dede700 1 Processor -- start 2021-03-09T08:40:30.216 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.209+0000 7f172dede700 1 -- start start 2021-03-09T08:40:30.216 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f172dede700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1728131d20 con 0x7f17280ad080 2021-03-09T08:40:30.216 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f172dede700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1728133320 con 0x7f172812f800 2021-03-09T08:40:30.217 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f172dede700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17281323e0 con 0x7f17281395d0 2021-03-09T08:40:30.217 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f1726ffd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f172812f800 0x7f172812b650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42256/0 (socket says 172.21.15.106:42256) 2021-03-09T08:40:30.217 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f1726ffd700 1 -- 172.21.15.106:0/3047139558 learned_addr learned my addr 172.21.15.106:0/3047139558 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-03-09T08:40:30.217 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676583898 0 0) 0x7f1728133320 con 0x7f172812f800 2021-03-09T08:40:30.218 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f170c003230 con 0x7f172812f800 2021-03-09T08:40:30.218 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929244396 0 0) 0x7f17281323e0 con 0x7f17281395d0 2021-03-09T08:40:30.218 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1728133320 con 0x7f17281395d0 2021-03-09T08:40:30.218 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465484395 0 0) 0x7f17280a2040 con 0x7f17280ad080 2021-03-09T08:40:30.219 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17281323e0 con 0x7f17280ad080 2021-03-09T08:40:30.219 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2798729453 0 0) 0x7f170c003230 con 0x7f172812f800 2021-03-09T08:40:30.219 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f17280a2040 con 0x7f172812f800 2021-03-09T08:40:30.219 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f1710001b10 con 0x7f172812f800 2021-03-09T08:40:30.220 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 <== mon.1 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 33701287 0 0) 0x7f17280a2040 con 0x7f172812f800 2021-03-09T08:40:30.220 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 >> v1:172.21.15.91:6790/0 conn(0x7f17281395d0 legacy=0x7f172814fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:30.220 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 >> v1:172.21.15.91:6789/0 conn(0x7f17280ad080 legacy=0x7f17281299c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:30.220 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1728132ec0 con 0x7f172812f800 2021-03-09T08:40:30.220 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f172dede700 1 -- 172.21.15.106:0/3047139558 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172812bd60 con 0x7f172812f800 2021-03-09T08:40:30.221 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f172dede700 1 -- 172.21.15.106:0/3047139558 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f172812c230 con 0x7f172812f800 2021-03-09T08:40:30.221 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 <== mon.1 v1:172.21.15.106:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f17100011f0 con 0x7f172812f800 2021-03-09T08:40:30.221 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 <== mon.1 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f1710004cd0 con 0x7f172812f800 2021-03-09T08:40:30.221 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 <== mon.1 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7f1710005110 con 0x7f172812f800 2021-03-09T08:40:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 <== mon.1 v1:172.21.15.106:6789/0 8 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (unknown 2238011914 0 0) 0x7f17100064d0 con 0x7f172812f800 2021-03-09T08:40:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.213+0000 7f172dede700 1 -- 172.21.15.106:0/3047139558 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1700004d60 con 0x7f172812f800 2021-03-09T08:40:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.221+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 <== mon.1 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (unknown 1092875540 0 637523725) 0x7f1710005f70 con 0x7f172812f800 2021-03-09T08:40:30.305 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.305+0000 7f172dede700 1 -- 172.21.15.106:0/3047139558 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd new", "uuid": "e5ffeaee-5262-41b6-b548-5d1a476feaaf", "id": 6} v 0) v1 -- 0x7f1700005010 con 0x7f172812f800 2021-03-09T08:40:30.311 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.313+0000 7f171f7fe700 1 -- 172.21.15.106:0/3047139558 <== mon.1 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e5ffeaee-5262-41b6-b548-5d1a476feaaf", "id": 6}]=0 v9) v1 ==== 112+0+2 (unknown 369171816 0 1113811849) 0x7f1710006270 con 0x7f172812f800 2021-03-09T08:40:30.312 INFO:teuthology.orchestra.run.smithi106.stdout:6 2021-03-09T08:40:30.313 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.313+0000 7f172dede700 1 -- 172.21.15.106:0/3047139558 >> v1:172.21.15.106:6789/0 conn(0x7f172812f800 legacy=0x7f172812b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:30.313 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.313+0000 7f172dede700 1 -- 172.21.15.106:0/3047139558 shutdown_connections 2021-03-09T08:40:30.313 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.313+0000 7f172dede700 1 -- 172.21.15.106:0/3047139558 >> 172.21.15.106:0/3047139558 conn(0x7f1728061810 msgr2=0x7f172805cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:30.314 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.313+0000 7f172dede700 1 -- 172.21.15.106:0/3047139558 shutdown_connections 2021-03-09T08:40:30.314 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.313+0000 7f172dede700 1 -- 172.21.15.106:0/3047139558 wait complete. 2021-03-09T08:40:30.328 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 52260ac7-2d7c-41b0-88bc-9309cceccc7d 7 2021-03-09T08:40:30.501 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.501+0000 7f5d53fff700 1 Processor -- start 2021-03-09T08:40:30.502 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.501+0000 7f5d53fff700 1 -- start start 2021-03-09T08:40:30.503 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.501+0000 7f5d53fff700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d540622e0 con 0x7f5d54061f00 2021-03-09T08:40:30.503 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.501+0000 7f5d53fff700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d540a4850 con 0x7f5d54133680 2021-03-09T08:40:30.503 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.501+0000 7f5d53fff700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d540a0640 con 0x7f5d540a0100 2021-03-09T08:40:30.503 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.501+0000 7f5d537fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5d54133680 0x7f5d5413e7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42264/0 (socket says 172.21.15.106:42264) 2021-03-09T08:40:30.504 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.501+0000 7f5d537fe700 1 -- 172.21.15.106:0/3692706747 learned_addr learned my addr 172.21.15.106:0/3692706747 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-03-09T08:40:30.506 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d527fc700 1 -- 172.21.15.106:0/3692706747 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059655631 0 0) 0x7f5d540a4850 con 0x7f5d54133680 2021-03-09T08:40:30.506 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d527fc700 1 -- 172.21.15.106:0/3692706747 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d34003230 con 0x7f5d54133680 2021-03-09T08:40:30.507 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d527fc700 1 -- 172.21.15.106:0/3692706747 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498525021 0 0) 0x7f5d540a0640 con 0x7f5d540a0100 2021-03-09T08:40:30.507 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d527fc700 1 -- 172.21.15.106:0/3692706747 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d540a4850 con 0x7f5d540a0100 2021-03-09T08:40:30.508 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d527fc700 1 -- 172.21.15.106:0/3692706747 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173736135 0 0) 0x7f5d540622e0 con 0x7f5d54061f00 2021-03-09T08:40:30.508 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d527fc700 1 -- 172.21.15.106:0/3692706747 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d540a0640 con 0x7f5d54061f00 2021-03-09T08:40:30.509 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d527fc700 1 -- 172.21.15.106:0/3692706747 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1999121585 0 0) 0x7f5d34003230 con 0x7f5d54133680 2021-03-09T08:40:30.509 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d527fc700 1 -- 172.21.15.106:0/3692706747 >> v1:172.21.15.91:6790/0 conn(0x7f5d540a0100 legacy=0x7f5d54067fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:30.509 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d527fc700 1 -- 172.21.15.106:0/3692706747 >> v1:172.21.15.91:6789/0 conn(0x7f5d54061f00 legacy=0x7f5d54132f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:30.509 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d527fc700 1 -- 172.21.15.106:0/3692706747 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d540a0ae0 con 0x7f5d54133680 2021-03-09T08:40:30.510 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d527fc700 1 -- 172.21.15.106:0/3692706747 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f5d4c001a50 con 0x7f5d54133680 2021-03-09T08:40:30.510 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d527fc700 1 -- 172.21.15.106:0/3692706747 <== mon.1 v1:172.21.15.106:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5d4c001d30 con 0x7f5d54133680 2021-03-09T08:40:30.510 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d527fc700 1 -- 172.21.15.106:0/3692706747 <== mon.1 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f5d4c0020c0 con 0x7f5d54133680 2021-03-09T08:40:30.510 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d53fff700 1 -- 172.21.15.106:0/3692706747 >> v1:172.21.15.106:6789/0 conn(0x7f5d54133680 legacy=0x7f5d5413e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:30.511 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d53fff700 1 -- 172.21.15.106:0/3692706747 shutdown_connections 2021-03-09T08:40:30.511 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d53fff700 1 -- 172.21.15.106:0/3692706747 >> 172.21.15.106:0/3692706747 conn(0x7f5d540a9750 msgr2=0x7f5d540a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:30.511 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d53fff700 1 -- 172.21.15.106:0/3692706747 shutdown_connections 2021-03-09T08:40:30.511 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d53fff700 1 -- 172.21.15.106:0/3692706747 wait complete. 2021-03-09T08:40:30.516 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d53fff700 1 Processor -- start 2021-03-09T08:40:30.516 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.505+0000 7f5d53fff700 1 -- start start 2021-03-09T08:40:30.516 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d53fff700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d54065290 con 0x7f5d54061f00 2021-03-09T08:40:30.516 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d53fff700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5412f790 con 0x7f5d540a0100 2021-03-09T08:40:30.517 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d53fff700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5412f920 con 0x7f5d54133680 2021-03-09T08:40:30.517 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4bfff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5d540a0100 0x7f5d54145da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42266/0 (socket says 172.21.15.106:42266) 2021-03-09T08:40:30.517 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4bfff700 1 -- 172.21.15.106:0/3924520796 learned_addr learned my addr 172.21.15.106:0/3924520796 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-03-09T08:40:30.518 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922035585 0 0) 0x7f5d5412f790 con 0x7f5d540a0100 2021-03-09T08:40:30.518 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d38003230 con 0x7f5d540a0100 2021-03-09T08:40:30.518 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 735497737 0 0) 0x7f5d54065290 con 0x7f5d54061f00 2021-03-09T08:40:30.518 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d5412f790 con 0x7f5d54061f00 2021-03-09T08:40:30.518 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029078478 0 0) 0x7f5d5412f920 con 0x7f5d54133680 2021-03-09T08:40:30.519 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d54065290 con 0x7f5d54133680 2021-03-09T08:40:30.519 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3927090813 0 0) 0x7f5d38003230 con 0x7f5d540a0100 2021-03-09T08:40:30.519 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5d5412f920 con 0x7f5d540a0100 2021-03-09T08:40:30.520 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f5d3c0019e0 con 0x7f5d540a0100 2021-03-09T08:40:30.520 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 <== mon.1 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4219934600 0 0) 0x7f5d5412f920 con 0x7f5d540a0100 2021-03-09T08:40:30.520 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 >> v1:172.21.15.91:6790/0 conn(0x7f5d54133680 legacy=0x7f5d5412f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:30.521 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 >> v1:172.21.15.91:6789/0 conn(0x7f5d54061f00 legacy=0x7f5d54135c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:30.521 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d54064d50 con 0x7f5d540a0100 2021-03-09T08:40:30.521 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d53fff700 1 -- 172.21.15.106:0/3924520796 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d54065020 con 0x7f5d540a0100 2021-03-09T08:40:30.522 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d53fff700 1 -- 172.21.15.106:0/3924520796 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d54115ab0 con 0x7f5d540a0100 2021-03-09T08:40:30.522 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 <== mon.1 v1:172.21.15.106:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5d3c002c90 con 0x7f5d540a0100 2021-03-09T08:40:30.522 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 <== mon.1 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f5d3c002110 con 0x7f5d540a0100 2021-03-09T08:40:30.522 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 <== mon.1 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7f5d3c0025d0 con 0x7f5d540a0100 2021-03-09T08:40:30.523 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 <== mon.1 v1:172.21.15.106:6789/0 8 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (unknown 946467710 0 0) 0x7f5d3c006360 con 0x7f5d540a0100 2021-03-09T08:40:30.523 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.509+0000 7f5d53fff700 1 -- 172.21.15.106:0/3924520796 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2c004d60 con 0x7f5d540a0100 2021-03-09T08:40:30.523 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.513+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 <== mon.1 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (unknown 1092875540 0 637523725) 0x7f5d3c0054d0 con 0x7f5d540a0100 2021-03-09T08:40:30.599 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.597+0000 7f5d53fff700 1 -- 172.21.15.106:0/3924520796 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd new", "uuid": "52260ac7-2d7c-41b0-88bc-9309cceccc7d", "id": 7} v 0) v1 -- 0x7f5d2c005590 con 0x7f5d540a0100 2021-03-09T08:40:30.606 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.605+0000 7f5d4affd700 1 -- 172.21.15.106:0/3924520796 <== mon.1 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "52260ac7-2d7c-41b0-88bc-9309cceccc7d", "id": 7}]=0 v10) v1 ==== 112+0+2 (unknown 3028101275 0 1371665406) 0x7f5d3c005710 con 0x7f5d540a0100 2021-03-09T08:40:30.606 INFO:teuthology.orchestra.run.smithi106.stdout:7 2021-03-09T08:40:30.607 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.605+0000 7f5d53fff700 1 -- 172.21.15.106:0/3924520796 >> v1:172.21.15.106:6789/0 conn(0x7f5d540a0100 legacy=0x7f5d54145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:30.608 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.605+0000 7f5d53fff700 1 -- 172.21.15.106:0/3924520796 shutdown_connections 2021-03-09T08:40:30.608 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.609+0000 7f5d53fff700 1 -- 172.21.15.106:0/3924520796 >> 172.21.15.106:0/3924520796 conn(0x7f5d540a9750 msgr2=0x7f5d5409e320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:30.608 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.609+0000 7f5d53fff700 1 -- 172.21.15.106:0/3924520796 shutdown_connections 2021-03-09T08:40:30.608 INFO:teuthology.orchestra.run.smithi106.stderr:2021-03-09T08:40:30.609+0000 7f5d53fff700 1 -- 172.21.15.106:0/3924520796 wait complete. 2021-03-09T08:40:30.626 INFO:tasks.ceph.osd.0:Restarting daemon 2021-03-09T08:40:30.626 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-03-09T08:40:30.629 INFO:tasks.ceph.osd.0:Started 2021-03-09T08:40:30.629 INFO:tasks.ceph.osd.1:Restarting daemon 2021-03-09T08:40:30.630 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-03-09T08:40:30.632 INFO:tasks.ceph.osd.1:Started 2021-03-09T08:40:30.632 INFO:tasks.ceph.osd.2:Restarting daemon 2021-03-09T08:40:30.633 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-03-09T08:40:30.635 INFO:tasks.ceph.osd.2:Started 2021-03-09T08:40:30.635 INFO:tasks.ceph.osd.3:Restarting daemon 2021-03-09T08:40:30.636 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-03-09T08:40:30.638 INFO:tasks.ceph.osd.3:Started 2021-03-09T08:40:30.639 INFO:tasks.ceph.osd.4:Restarting daemon 2021-03-09T08:40:30.639 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-03-09T08:40:30.641 INFO:tasks.ceph.osd.4:Started 2021-03-09T08:40:30.642 INFO:tasks.ceph.osd.5:Restarting daemon 2021-03-09T08:40:30.642 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-03-09T08:40:30.645 INFO:tasks.ceph.osd.5:Started 2021-03-09T08:40:30.645 INFO:tasks.ceph.osd.6:Restarting daemon 2021-03-09T08:40:30.646 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2021-03-09T08:40:30.648 INFO:tasks.ceph.osd.6:Started 2021-03-09T08:40:30.648 INFO:tasks.ceph.osd.7:Restarting daemon 2021-03-09T08:40:30.649 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2021-03-09T08:40:30.652 INFO:tasks.ceph.osd.7:Started 2021-03-09T08:40:30.652 INFO:tasks.ceph:Waiting for OSDs to come up 2021-03-09T08:40:31.062 INFO:tasks.ceph.osd.2.smithi091.stderr:2021-03-09T08:40:31.064+0000 7fc60ff57f00 -1 Falling back to public interface 2021-03-09T08:40:31.062 INFO:tasks.ceph.osd.3.smithi091.stderr:2021-03-09T08:40:31.064+0000 7f9fcd734f00 -1 Falling back to public interface 2021-03-09T08:40:31.064 INFO:tasks.ceph.osd.5.smithi106.stderr:2021-03-09T08:40:31.065+0000 7f1cb3c5cf00 -1 Falling back to public interface 2021-03-09T08:40:31.305 INFO:tasks.ceph.osd.4.smithi106.stderr:2021-03-09T08:40:31.305+0000 7f66e7ccff00 -1 Falling back to public interface 2021-03-09T08:40:31.318 INFO:tasks.ceph.osd.6.smithi106.stderr:2021-03-09T08:40:31.317+0000 7f0d061b5f00 -1 Falling back to public interface 2021-03-09T08:40:31.318 INFO:tasks.ceph.osd.7.smithi106.stderr:2021-03-09T08:40:31.317+0000 7f585b83bf00 -1 Falling back to public interface 2021-03-09T08:40:31.334 INFO:tasks.ceph.osd.1.smithi091.stderr:2021-03-09T08:40:31.336+0000 7fcdebf8af00 -1 Falling back to public interface 2021-03-09T08:40:31.338 INFO:tasks.ceph.osd.0.smithi091.stderr:2021-03-09T08:40:31.340+0000 7f5122450f00 -1 Falling back to public interface 2021-03-09T08:40:31.459 DEBUG:teuthology.orchestra.run.smithi091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-03-09T08:40:31.619 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.620+0000 7f7f4359e700 1 Processor -- start 2021-03-09T08:40:31.620 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.620+0000 7f7f4359e700 1 -- start start 2021-03-09T08:40:31.623 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.620+0000 7f7f4359e700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f4406abc0 con 0x7f7f4409f7a0 2021-03-09T08:40:31.623 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.620+0000 7f7f4359e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f4409f300 con 0x7f7f4406a7e0 2021-03-09T08:40:31.623 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.620+0000 7f7f4359e700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f44133590 con 0x7f7f44132180 2021-03-09T08:40:31.623 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.620+0000 7f7f41d9b700 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f7f4409f7a0 0x7f7f44132e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:46132/0 (socket says 172.21.15.91:46132) 2021-03-09T08:40:31.624 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.620+0000 7f7f41d9b700 1 -- 172.21.15.91:0/3201916447 learned_addr learned my addr 172.21.15.91:0/3201916447 (peer_addr_for_me v1:172.21.15.91:0/0) 2021-03-09T08:40:31.624 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.620+0000 7f7f4159a700 1 -- 172.21.15.91:0/3201916447 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131229302 0 0) 0x7f7f44133590 con 0x7f7f44132180 2021-03-09T08:40:31.624 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.620+0000 7f7f4159a700 1 -- 172.21.15.91:0/3201916447 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f28003230 con 0x7f7f44132180 2021-03-09T08:40:31.624 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.620+0000 7f7f4159a700 1 -- 172.21.15.91:0/3201916447 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843235028 0 0) 0x7f7f4406abc0 con 0x7f7f4409f7a0 2021-03-09T08:40:31.624 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.620+0000 7f7f4159a700 1 -- 172.21.15.91:0/3201916447 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f44133590 con 0x7f7f4409f7a0 2021-03-09T08:40:31.625 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.620+0000 7f7f4159a700 1 -- 172.21.15.91:0/3201916447 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560602283 0 0) 0x7f7f4409f300 con 0x7f7f4406a7e0 2021-03-09T08:40:31.625 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.620+0000 7f7f4159a700 1 -- 172.21.15.91:0/3201916447 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f4406abc0 con 0x7f7f4406a7e0 2021-03-09T08:40:31.625 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.620+0000 7f7f4159a700 1 -- 172.21.15.91:0/3201916447 <== mon.2 v1:172.21.15.91:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3044070587 0 0) 0x7f7f28003230 con 0x7f7f44132180 2021-03-09T08:40:31.625 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.620+0000 7f7f4159a700 1 -- 172.21.15.91:0/3201916447 >> v1:172.21.15.106:6789/0 conn(0x7f7f4406a7e0 legacy=0x7f7f440a4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:31.626 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.620+0000 7f7f4159a700 1 -- 172.21.15.91:0/3201916447 >> v1:172.21.15.91:6789/0 conn(0x7f7f4409f7a0 legacy=0x7f7f44132e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:31.626 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f4159a700 1 -- 172.21.15.91:0/3201916447 --> v1:172.21.15.91:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4409eea0 con 0x7f7f44132180 2021-03-09T08:40:31.626 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f4159a700 1 -- 172.21.15.91:0/3201916447 <== mon.2 v1:172.21.15.91:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f7f3c001a00 con 0x7f7f44132180 2021-03-09T08:40:31.627 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f4159a700 1 -- 172.21.15.91:0/3201916447 <== mon.2 v1:172.21.15.91:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7f3c001c20 con 0x7f7f44132180 2021-03-09T08:40:31.627 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f4159a700 1 -- 172.21.15.91:0/3201916447 <== mon.2 v1:172.21.15.91:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f7f3c001fb0 con 0x7f7f44132180 2021-03-09T08:40:31.627 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f4359e700 1 -- 172.21.15.91:0/3201916447 >> v1:172.21.15.91:6790/0 conn(0x7f7f44132180 legacy=0x7f7f441325f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:31.628 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f4359e700 1 -- 172.21.15.91:0/3201916447 shutdown_connections 2021-03-09T08:40:31.628 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f4359e700 1 -- 172.21.15.91:0/3201916447 >> 172.21.15.91:0/3201916447 conn(0x7f7f440a8c50 msgr2=0x7f7f440a9060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:31.628 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f4359e700 1 -- 172.21.15.91:0/3201916447 shutdown_connections 2021-03-09T08:40:31.629 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f4359e700 1 -- 172.21.15.91:0/3201916447 wait complete. 2021-03-09T08:40:31.629 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f4359e700 1 Processor -- start 2021-03-09T08:40:31.629 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f4359e700 1 -- start start 2021-03-09T08:40:31.632 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f4359e700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f44068190 con 0x7f7f4409f7a0 2021-03-09T08:40:31.633 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f4359e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f44134310 con 0x7f7f4406a7e0 2021-03-09T08:40:31.633 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f4359e700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f440a8350 con 0x7f7f44132180 2021-03-09T08:40:31.633 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f41d9b700 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f7f4409f7a0 0x7f7f440a7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:46138/0 (socket says 172.21.15.91:46138) 2021-03-09T08:40:31.634 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f41d9b700 1 -- 172.21.15.91:0/3194008006 learned_addr learned my addr 172.21.15.91:0/3194008006 (peer_addr_for_me v1:172.21.15.91:0/0) 2021-03-09T08:40:31.634 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291910726 0 0) 0x7f7f440a8350 con 0x7f7f44132180 2021-03-09T08:40:31.634 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f20003230 con 0x7f7f44132180 2021-03-09T08:40:31.634 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196112023 0 0) 0x7f7f44068190 con 0x7f7f4409f7a0 2021-03-09T08:40:31.635 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f440a8350 con 0x7f7f4409f7a0 2021-03-09T08:40:31.635 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855590060 0 0) 0x7f7f44134310 con 0x7f7f4406a7e0 2021-03-09T08:40:31.635 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f44068190 con 0x7f7f4406a7e0 2021-03-09T08:40:31.635 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 <== mon.2 v1:172.21.15.91:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3879235721 0 0) 0x7f7f20003230 con 0x7f7f44132180 2021-03-09T08:40:31.636 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 --> v1:172.21.15.91:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7f44134310 con 0x7f7f44132180 2021-03-09T08:40:31.636 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 <== mon.2 v1:172.21.15.91:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f7f3c001f70 con 0x7f7f44132180 2021-03-09T08:40:31.637 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1335620364 0 0) 0x7f7f440a8350 con 0x7f7f4409f7a0 2021-03-09T08:40:31.637 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 --> v1:172.21.15.91:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7f20003230 con 0x7f7f4409f7a0 2021-03-09T08:40:31.637 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f7f38001330 con 0x7f7f4409f7a0 2021-03-09T08:40:31.638 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 <== mon.0 v1:172.21.15.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3373981432 0 0) 0x7f7f20003230 con 0x7f7f4409f7a0 2021-03-09T08:40:31.641 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 >> v1:172.21.15.91:6790/0 conn(0x7f7f44132180 legacy=0x7f7f440a6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:31.641 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 >> v1:172.21.15.106:6789/0 conn(0x7f7f4406a7e0 legacy=0x7f7f440667d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:31.642 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f440a84e0 con 0x7f7f4409f7a0 2021-03-09T08:40:31.642 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f4359e700 1 -- 172.21.15.91:0/3194008006 --> v1:172.21.15.91:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f440a7260 con 0x7f7f4409f7a0 2021-03-09T08:40:31.642 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.624+0000 7f7f4359e700 1 -- 172.21.15.91:0/3194008006 --> v1:172.21.15.91:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f44065da0 con 0x7f7f4409f7a0 2021-03-09T08:40:31.642 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.628+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 <== mon.0 v1:172.21.15.91:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7f38001570 con 0x7f7f4409f7a0 2021-03-09T08:40:31.642 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.628+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 <== mon.0 v1:172.21.15.91:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f7f38004940 con 0x7f7f4409f7a0 2021-03-09T08:40:31.643 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.628+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 <== mon.0 v1:172.21.15.91:6789/0 7 ==== mgrmap(e 1) v1 ==== 623+0+0 (unknown 1065898531 0 0) 0x7f7f38004d80 con 0x7f7f4409f7a0 2021-03-09T08:40:31.643 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.628+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 <== mon.0 v1:172.21.15.91:6789/0 8 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (unknown 3344885567 0 0) 0x7f7f38006330 con 0x7f7f4409f7a0 2021-03-09T08:40:31.643 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.628+0000 7f7f4359e700 1 -- 172.21.15.91:0/3194008006 --> v1:172.21.15.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f24004d50 con 0x7f7f4409f7a0 2021-03-09T08:40:31.643 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.628+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 <== mon.0 v1:172.21.15.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72044 (unknown 1092875540 0 637523725) 0x7f7f38005d40 con 0x7f7f4409f7a0 2021-03-09T08:40:31.694 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.696+0000 7f7f4359e700 1 -- 172.21.15.91:0/3194008006 --> v1:172.21.15.91:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f24005000 con 0x7f7f4409f7a0 2021-03-09T08:40:31.696 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.696+0000 7f7f327fc700 1 -- 172.21.15.91:0/3194008006 <== mon.0 v1:172.21.15.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7023 (unknown 4040575075 0 1738595446) 0x7f7f38005fa0 con 0x7f7f4409f7a0 2021-03-09T08:40:31.697 INFO:teuthology.misc.health.smithi091.stdout: 2021-03-09T08:40:31.697 INFO:teuthology.misc.health.smithi091.stdout:{"epoch":10,"fsid":"e6444b40-8694-46ba-959c-a5e888845ea5","created":"2021-03-09T08:40:27.549021+0000","modified":"2021-03-09T08:40:30.603939+0000","last_up_change":"0.000000","last_in_change":"2021-03-09T08:40:30.603939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"d320711c-c382-48d3-bde9-d4787c3c1b58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"985e5655-b76d-408a-8029-06d21a1e4034","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9e2a9318-2469-4fbf-a6d9-2c8a5977839f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f8d9be67-32be-4716-a240-d768d5a50465","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"23c43fc1-8b3e-4e3b-b710-a638544f04fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8ced66cb-bff4-4e6d-bbdb-825f34496f8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e5ffeaee-5262-41b6-b548-5d1a476feaaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"52260ac7-2d7c-41b0-88bc-9309cceccc7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-09T08:40:31.699 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.700+0000 7f7f4359e700 1 -- 172.21.15.91:0/3194008006 >> v1:172.21.15.91:6789/0 conn(0x7f7f4409f7a0 legacy=0x7f7f440a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:31.699 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.700+0000 7f7f4359e700 1 -- 172.21.15.91:0/3194008006 shutdown_connections 2021-03-09T08:40:31.700 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.700+0000 7f7f4359e700 1 -- 172.21.15.91:0/3194008006 >> 172.21.15.91:0/3194008006 conn(0x7f7f440a8c50 msgr2=0x7f7f440a9030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:31.700 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.700+0000 7f7f4359e700 1 -- 172.21.15.91:0/3194008006 shutdown_connections 2021-03-09T08:40:31.701 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:31.700+0000 7f7f4359e700 1 -- 172.21.15.91:0/3194008006 wait complete. 2021-03-09T08:40:31.711 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-03-09T08:40:34.827 INFO:tasks.ceph.osd.2.smithi091.stderr:2021-03-09T08:40:34.828+0000 7fc60ff57f00 -1 osd.2 0 log_to_monitors {default=true} 2021-03-09T08:40:35.094 INFO:tasks.ceph.osd.5.smithi106.stderr:2021-03-09T08:40:34.861+0000 7f1cb3c5cf00 -1 osd.5 0 log_to_monitors {default=true} 2021-03-09T08:40:35.095 INFO:tasks.ceph.osd.3.smithi091.stderr:2021-03-09T08:40:34.896+0000 7f9fcd734f00 -1 osd.3 0 log_to_monitors {default=true} 2021-03-09T08:40:35.095 INFO:tasks.ceph.osd.7.smithi106.stderr:2021-03-09T08:40:34.929+0000 7f585b83bf00 -1 osd.7 0 log_to_monitors {default=true} 2021-03-09T08:40:35.096 INFO:tasks.ceph.osd.0.smithi091.stderr:2021-03-09T08:40:34.916+0000 7f5122450f00 -1 osd.0 0 log_to_monitors {default=true} 2021-03-09T08:40:35.096 INFO:tasks.ceph.osd.4.smithi106.stderr:2021-03-09T08:40:35.081+0000 7f66e7ccff00 -1 osd.4 0 log_to_monitors {default=true} 2021-03-09T08:40:35.131 INFO:tasks.ceph.osd.1.smithi091.stderr:2021-03-09T08:40:35.132+0000 7fcdebf8af00 -1 osd.1 0 log_to_monitors {default=true} 2021-03-09T08:40:35.136 INFO:tasks.ceph.osd.6.smithi106.stderr:2021-03-09T08:40:35.137+0000 7f0d061b5f00 -1 osd.6 0 log_to_monitors {default=true} 2021-03-09T08:40:36.659 INFO:tasks.ceph.osd.1.smithi091.stderr:2021-03-09T08:40:36.660+0000 7fcde3454700 -1 osd.1 0 waiting for initial osdmap 2021-03-09T08:40:36.661 INFO:tasks.ceph.osd.2.smithi091.stderr:2021-03-09T08:40:36.664+0000 7fc607421700 -1 osd.2 0 waiting for initial osdmap 2021-03-09T08:40:36.663 INFO:tasks.ceph.osd.6.smithi106.stderr:2021-03-09T08:40:36.661+0000 7f0cfd67f700 -1 osd.6 0 waiting for initial osdmap 2021-03-09T08:40:36.666 INFO:tasks.ceph.osd.0.smithi091.stderr:2021-03-09T08:40:36.664+0000 7f511b11d700 -1 osd.0 0 waiting for initial osdmap 2021-03-09T08:40:36.668 INFO:tasks.ceph.osd.3.smithi091.stderr:2021-03-09T08:40:36.668+0000 7f9fc4bfe700 -1 osd.3 0 waiting for initial osdmap 2021-03-09T08:40:36.673 INFO:tasks.ceph.osd.5.smithi106.stderr:2021-03-09T08:40:36.665+0000 7f1cab126700 -1 osd.5 0 waiting for initial osdmap 2021-03-09T08:40:36.673 INFO:tasks.ceph.osd.7.smithi106.stderr:2021-03-09T08:40:36.665+0000 7f5852d05700 -1 osd.7 0 waiting for initial osdmap 2021-03-09T08:40:36.674 INFO:tasks.ceph.osd.4.smithi106.stderr:2021-03-09T08:40:36.669+0000 7f66df199700 -1 osd.4 0 waiting for initial osdmap 2021-03-09T08:40:37.721 INFO:tasks.ceph.mon.a.smithi091.stderr:/build/ceph-17.0.0-1742-g89fb622b/src/osd/OSDMapMapping.h: In function 'mempool::osdmap_mapping::vector& OSDMapMapping::get_osd_acting_pgs(unsigned int)' thread 7f2b5dfd9700 time 2021-03-09T08:40:37.725473+0000 2021-03-09T08:40:37.722 INFO:tasks.ceph.mon.a.smithi091.stderr:/build/ceph-17.0.0-1742-g89fb622b/src/osd/OSDMapMapping.h: 325: FAILED ceph_assert(osd < acting_rmap.size()) 2021-03-09T08:40:37.726 INFO:tasks.ceph.mon.a.smithi091.stderr: ceph version 17.0.0-1742-g89fb622b (89fb622b10ca2e58fe0c913a8956377a886e2ab4) quincy (dev) 2021-03-09T08:40:37.726 INFO:tasks.ceph.mon.a.smithi091.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f2b6a79b3dd] 2021-03-09T08:40:37.727 INFO:tasks.ceph.mon.a.smithi091.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f2b6a79b5b8] 2021-03-09T08:40:37.727 INFO:tasks.ceph.mon.a.smithi091.stderr: 3: (OSDMonitor::check_pg_num(long, int, int, int, std::ostream*)+0x4f5) [0x556f2bacfa65] 2021-03-09T08:40:37.727 INFO:tasks.ceph.mon.a.smithi091.stderr: 4: (OSDMonitor::prepare_new_pool(std::__cxx11::basic_string, std::allocator >&, int, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned int, unsigned int, unsigned long, unsigned long, float, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned long, OSDMonitor::FastReadType, std::__cxx11::basic_string, std::allocator > const&, std::ostream*)+0x551) [0x556f2bb1ba71] 2021-03-09T08:40:37.727 INFO:tasks.ceph.mon.a.smithi091.stderr: 5: (OSDMonitor::prepare_command_impl(boost::intrusive_ptr, std::map, std::allocator >, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > >, std::less, std::allocator, std::allocator > const, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > > > > > const&)+0x1e4c5) [0x556f2bb4b295] 2021-03-09T08:40:37.728 INFO:tasks.ceph.mon.a.smithi091.stderr: 6: (OSDMonitor::prepare_command(boost::intrusive_ptr)+0x10b) [0x556f2bb5324b] 2021-03-09T08:40:37.728 INFO:tasks.ceph.mon.a.smithi091.stderr: 7: (OSDMonitor::prepare_update(boost::intrusive_ptr)+0x26b) [0x556f2bb537ab] 2021-03-09T08:40:37.728 INFO:tasks.ceph.mon.a.smithi091.stderr: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0x9be) [0x556f2bac2ade] 2021-03-09T08:40:37.728 INFO:tasks.ceph.mon.a.smithi091.stderr: 9: (Monitor::handle_command(boost::intrusive_ptr)+0x47d9) [0x556f2b9adc79] 2021-03-09T08:40:37.729 INFO:tasks.ceph.mon.a.smithi091.stderr: 10: (Monitor::dispatch_op(boost::intrusive_ptr)+0x849) [0x556f2b9b1229] 2021-03-09T08:40:37.729 INFO:tasks.ceph.mon.a.smithi091.stderr: 11: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x556f2b9b266a] 2021-03-09T08:40:37.729 INFO:tasks.ceph.mon.a.smithi091.stderr: 12: (Monitor::handle_forward(boost::intrusive_ptr)+0x68f) [0x556f2b9b387f] 2021-03-09T08:40:37.729 INFO:tasks.ceph.mon.a.smithi091.stderr: 13: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1390) [0x556f2b9b1d70] 2021-03-09T08:40:37.729 INFO:tasks.ceph.mon.a.smithi091.stderr: 14: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x556f2b9b266a] 2021-03-09T08:40:37.730 INFO:tasks.ceph.mon.a.smithi091.stderr: 15: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x556f2b9e0178] 2021-03-09T08:40:37.730 INFO:tasks.ceph.mon.a.smithi091.stderr: 16: (DispatchQueue::entry()+0x11ea) [0x7f2b6a99d2ca] 2021-03-09T08:40:37.730 INFO:tasks.ceph.mon.a.smithi091.stderr: 17: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f2b6aa4771d] 2021-03-09T08:40:37.730 INFO:tasks.ceph.mon.a.smithi091.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f2b6960b6db] 2021-03-09T08:40:37.731 INFO:tasks.ceph.mon.a.smithi091.stderr: 19: clone() 2021-03-09T08:40:37.731 INFO:tasks.ceph.mon.a.smithi091.stderr:*** Caught signal (Aborted) ** 2021-03-09T08:40:37.732 INFO:tasks.ceph.mon.a.smithi091.stderr: in thread 7f2b5dfd9700 thread_name:ms_dispatch 2021-03-09T08:40:37.732 INFO:tasks.ceph.mon.a.smithi091.stderr:2021-03-09T08:40:37.728+0000 7f2b5dfd9700 -1 /build/ceph-17.0.0-1742-g89fb622b/src/osd/OSDMapMapping.h: In function 'mempool::osdmap_mapping::vector& OSDMapMapping::get_osd_acting_pgs(unsigned int)' thread 7f2b5dfd9700 time 2021-03-09T08:40:37.725473+0000 2021-03-09T08:40:37.732 INFO:tasks.ceph.mon.a.smithi091.stderr:/build/ceph-17.0.0-1742-g89fb622b/src/osd/OSDMapMapping.h: 325: FAILED ceph_assert(osd < acting_rmap.size()) 2021-03-09T08:40:37.732 INFO:tasks.ceph.mon.a.smithi091.stderr: 2021-03-09T08:40:37.733 INFO:tasks.ceph.mon.a.smithi091.stderr: ceph version 17.0.0-1742-g89fb622b (89fb622b10ca2e58fe0c913a8956377a886e2ab4) quincy (dev) 2021-03-09T08:40:37.733 INFO:tasks.ceph.mon.a.smithi091.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f2b6a79b3dd] 2021-03-09T08:40:37.733 INFO:tasks.ceph.mon.a.smithi091.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f2b6a79b5b8] 2021-03-09T08:40:37.733 INFO:tasks.ceph.mon.a.smithi091.stderr: 3: (OSDMonitor::check_pg_num(long, int, int, int, std::ostream*)+0x4f5) [0x556f2bacfa65] 2021-03-09T08:40:37.734 INFO:tasks.ceph.mon.a.smithi091.stderr: 4: (OSDMonitor::prepare_new_pool(std::__cxx11::basic_string, std::allocator >&, int, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned int, unsigned int, unsigned long, unsigned long, float, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned long, OSDMonitor::FastReadType, std::__cxx11::basic_string, std::allocator > const&, std::ostream*)+0x551) [0x556f2bb1ba71] 2021-03-09T08:40:37.734 INFO:tasks.ceph.mon.a.smithi091.stderr: 5: (OSDMonitor::prepare_command_impl(boost::intrusive_ptr, std::map, std::allocator >, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > >, std::less, std::allocator, std::allocator > const, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > > > > > const&)+0x1e4c5) [0x556f2bb4b295] 2021-03-09T08:40:37.734 INFO:tasks.ceph.mon.a.smithi091.stderr: 6: (OSDMonitor::prepare_command(boost::intrusive_ptr)+0x10b) [0x556f2bb5324b] 2021-03-09T08:40:37.735 INFO:tasks.ceph.mon.a.smithi091.stderr: 7: (OSDMonitor::prepare_update(boost::intrusive_ptr)+0x26b) [0x556f2bb537ab] 2021-03-09T08:40:37.735 INFO:tasks.ceph.mon.a.smithi091.stderr: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0x9be) [0x556f2bac2ade] 2021-03-09T08:40:37.735 INFO:tasks.ceph.mon.a.smithi091.stderr: 9: (Monitor::handle_command(boost::intrusive_ptr)+0x47d9) [0x556f2b9adc79] 2021-03-09T08:40:37.735 INFO:tasks.ceph.mon.a.smithi091.stderr: 10: (Monitor::dispatch_op(boost::intrusive_ptr)+0x849) [0x556f2b9b1229] 2021-03-09T08:40:37.735 INFO:tasks.ceph.mon.a.smithi091.stderr: 11: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x556f2b9b266a] 2021-03-09T08:40:37.736 INFO:tasks.ceph.mon.a.smithi091.stderr: 12: (Monitor::handle_forward(boost::intrusive_ptr)+0x68f) [0x556f2b9b387f] 2021-03-09T08:40:37.736 INFO:tasks.ceph.mon.a.smithi091.stderr: 13: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1390) [0x556f2b9b1d70] 2021-03-09T08:40:37.736 INFO:tasks.ceph.mon.a.smithi091.stderr: 14: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x556f2b9b266a] 2021-03-09T08:40:37.736 INFO:tasks.ceph.mon.a.smithi091.stderr: 15: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x556f2b9e0178] 2021-03-09T08:40:37.737 INFO:tasks.ceph.mon.a.smithi091.stderr: 16: (DispatchQueue::entry()+0x11ea) [0x7f2b6a99d2ca] 2021-03-09T08:40:37.737 INFO:tasks.ceph.mon.a.smithi091.stderr: 17: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f2b6aa4771d] 2021-03-09T08:40:37.737 INFO:tasks.ceph.mon.a.smithi091.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f2b6960b6db] 2021-03-09T08:40:37.737 INFO:tasks.ceph.mon.a.smithi091.stderr: 19: clone() 2021-03-09T08:40:37.737 INFO:tasks.ceph.mon.a.smithi091.stderr: 2021-03-09T08:40:37.738 INFO:tasks.ceph.mon.a.smithi091.stderr: ceph version 17.0.0-1742-g89fb622b (89fb622b10ca2e58fe0c913a8956377a886e2ab4) quincy (dev) 2021-03-09T08:40:37.739 INFO:tasks.ceph.mon.a.smithi091.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980) [0x7f2b69616980] 2021-03-09T08:40:37.739 INFO:tasks.ceph.mon.a.smithi091.stderr: 2: gsignal() 2021-03-09T08:40:37.739 INFO:tasks.ceph.mon.a.smithi091.stderr: 3: abort() 2021-03-09T08:40:37.739 INFO:tasks.ceph.mon.a.smithi091.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x19c) [0x7f2b6a79b42e] 2021-03-09T08:40:37.739 INFO:tasks.ceph.mon.a.smithi091.stderr: 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f2b6a79b5b8] 2021-03-09T08:40:37.740 INFO:tasks.ceph.mon.a.smithi091.stderr: 6: (OSDMonitor::check_pg_num(long, int, int, int, std::ostream*)+0x4f5) [0x556f2bacfa65] 2021-03-09T08:40:37.740 INFO:tasks.ceph.mon.a.smithi091.stderr: 7: (OSDMonitor::prepare_new_pool(std::__cxx11::basic_string, std::allocator >&, int, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned int, unsigned int, unsigned long, unsigned long, float, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned long, OSDMonitor::FastReadType, std::__cxx11::basic_string, std::allocator > const&, std::ostream*)+0x551) [0x556f2bb1ba71] 2021-03-09T08:40:37.740 INFO:tasks.ceph.mon.a.smithi091.stderr: 8: (OSDMonitor::prepare_command_impl(boost::intrusive_ptr, std::map, std::allocator >, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > >, std::less, std::allocator, std::allocator > const, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > > > > > const&)+0x1e4c5) [0x556f2bb4b295] 2021-03-09T08:40:37.741 INFO:tasks.ceph.mon.a.smithi091.stderr: 9: (OSDMonitor::prepare_command(boost::intrusive_ptr)+0x10b) [0x556f2bb5324b] 2021-03-09T08:40:37.741 INFO:tasks.ceph.mon.a.smithi091.stderr: 10: (OSDMonitor::prepare_update(boost::intrusive_ptr)+0x26b) [0x556f2bb537ab] 2021-03-09T08:40:37.741 INFO:tasks.ceph.mon.a.smithi091.stderr: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0x9be) [0x556f2bac2ade] 2021-03-09T08:40:37.741 INFO:tasks.ceph.mon.a.smithi091.stderr: 12: (Monitor::handle_command(boost::intrusive_ptr)+0x47d9) [0x556f2b9adc79] 2021-03-09T08:40:37.742 INFO:tasks.ceph.mon.a.smithi091.stderr: 13: (Monitor::dispatch_op(boost::intrusive_ptr)+0x849) [0x556f2b9b1229] 2021-03-09T08:40:37.742 INFO:tasks.ceph.mon.a.smithi091.stderr: 14: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x556f2b9b266a] 2021-03-09T08:40:37.742 INFO:tasks.ceph.mon.a.smithi091.stderr: 15: (Monitor::handle_forward(boost::intrusive_ptr)+0x68f) [0x556f2b9b387f] 2021-03-09T08:40:37.742 INFO:tasks.ceph.mon.a.smithi091.stderr: 16: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1390) [0x556f2b9b1d70] 2021-03-09T08:40:37.742 INFO:tasks.ceph.mon.a.smithi091.stderr: 17: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x556f2b9b266a] 2021-03-09T08:40:37.743 INFO:tasks.ceph.mon.a.smithi091.stderr: 18: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x556f2b9e0178] 2021-03-09T08:40:37.743 INFO:tasks.ceph.mon.a.smithi091.stderr: 19: (DispatchQueue::entry()+0x11ea) [0x7f2b6a99d2ca] 2021-03-09T08:40:37.743 INFO:tasks.ceph.mon.a.smithi091.stderr: 20: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f2b6aa4771d] 2021-03-09T08:40:37.743 INFO:tasks.ceph.mon.a.smithi091.stderr: 21: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f2b6960b6db] 2021-03-09T08:40:37.744 INFO:tasks.ceph.mon.a.smithi091.stderr: 22: clone() 2021-03-09T08:40:37.744 INFO:tasks.ceph.mon.a.smithi091.stderr:2021-03-09T08:40:37.736+0000 7f2b5dfd9700 -1 *** Caught signal (Aborted) ** 2021-03-09T08:40:37.744 INFO:tasks.ceph.mon.a.smithi091.stderr: in thread 7f2b5dfd9700 thread_name:ms_dispatch 2021-03-09T08:40:37.744 INFO:tasks.ceph.mon.a.smithi091.stderr: 2021-03-09T08:40:37.744 INFO:tasks.ceph.mon.a.smithi091.stderr: ceph version 17.0.0-1742-g89fb622b (89fb622b10ca2e58fe0c913a8956377a886e2ab4) quincy (dev) 2021-03-09T08:40:37.745 INFO:tasks.ceph.mon.a.smithi091.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980) [0x7f2b69616980] 2021-03-09T08:40:37.745 INFO:tasks.ceph.mon.a.smithi091.stderr: 2: gsignal() 2021-03-09T08:40:37.745 INFO:tasks.ceph.mon.a.smithi091.stderr: 3: abort() 2021-03-09T08:40:37.745 INFO:tasks.ceph.mon.a.smithi091.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x19c) [0x7f2b6a79b42e] 2021-03-09T08:40:37.746 INFO:tasks.ceph.mon.a.smithi091.stderr: 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f2b6a79b5b8] 2021-03-09T08:40:37.746 INFO:tasks.ceph.mon.a.smithi091.stderr: 6: (OSDMonitor::check_pg_num(long, int, int, int, std::ostream*)+0x4f5) [0x556f2bacfa65] 2021-03-09T08:40:37.746 INFO:tasks.ceph.mon.a.smithi091.stderr: 7: (OSDMonitor::prepare_new_pool(std::__cxx11::basic_string, std::allocator >&, int, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned int, unsigned int, unsigned long, unsigned long, float, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned long, OSDMonitor::FastReadType, std::__cxx11::basic_string, std::allocator > const&, std::ostream*)+0x551) [0x556f2bb1ba71] 2021-03-09T08:40:37.746 INFO:tasks.ceph.mon.a.smithi091.stderr: 8: (OSDMonitor::prepare_command_impl(boost::intrusive_ptr, std::map, std::allocator >, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > >, std::less, std::allocator, std::allocator > const, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > > > > > const&)+0x1e4c5) [0x556f2bb4b295] 2021-03-09T08:40:37.747 INFO:tasks.ceph.mon.a.smithi091.stderr: 9: (OSDMonitor::prepare_command(boost::intrusive_ptr)+0x10b) [0x556f2bb5324b] 2021-03-09T08:40:37.747 INFO:tasks.ceph.mon.a.smithi091.stderr: 10: (OSDMonitor::prepare_update(boost::intrusive_ptr)+0x26b) [0x556f2bb537ab] 2021-03-09T08:40:37.747 INFO:tasks.ceph.mon.a.smithi091.stderr: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0x9be) [0x556f2bac2ade] 2021-03-09T08:40:37.747 INFO:tasks.ceph.mon.a.smithi091.stderr: 12: (Monitor::handle_command(boost::intrusive_ptr)+0x47d9) [0x556f2b9adc79] 2021-03-09T08:40:37.747 INFO:tasks.ceph.mon.a.smithi091.stderr: 13: (Monitor::dispatch_op(boost::intrusive_ptr)+0x849) [0x556f2b9b1229] 2021-03-09T08:40:37.748 INFO:tasks.ceph.mon.a.smithi091.stderr: 14: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x556f2b9b266a] 2021-03-09T08:40:37.748 INFO:tasks.ceph.mon.a.smithi091.stderr: 15: (Monitor::handle_forward(boost::intrusive_ptr)+0x68f) [0x556f2b9b387f] 2021-03-09T08:40:37.748 INFO:tasks.ceph.mon.a.smithi091.stderr: 16: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1390) [0x556f2b9b1d70] 2021-03-09T08:40:37.748 INFO:tasks.ceph.mon.a.smithi091.stderr: 17: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x556f2b9b266a] 2021-03-09T08:40:37.748 INFO:tasks.ceph.mon.a.smithi091.stderr: 18: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x556f2b9e0178] 2021-03-09T08:40:37.749 INFO:tasks.ceph.mon.a.smithi091.stderr: 19: (DispatchQueue::entry()+0x11ea) [0x7f2b6a99d2ca] 2021-03-09T08:40:37.749 INFO:tasks.ceph.mon.a.smithi091.stderr: 20: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f2b6aa4771d] 2021-03-09T08:40:37.749 INFO:tasks.ceph.mon.a.smithi091.stderr: 21: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f2b6960b6db] 2021-03-09T08:40:37.749 INFO:tasks.ceph.mon.a.smithi091.stderr: 22: clone() 2021-03-09T08:40:37.750 INFO:tasks.ceph.mon.a.smithi091.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-03-09T08:40:37.750 INFO:tasks.ceph.mon.a.smithi091.stderr: 2021-03-09T08:40:37.750 INFO:tasks.ceph.mon.a.smithi091.stderr: -1> 2021-03-09T08:40:37.728+0000 7f2b5dfd9700 -1 /build/ceph-17.0.0-1742-g89fb622b/src/osd/OSDMapMapping.h: In function 'mempool::osdmap_mapping::vector& OSDMapMapping::get_osd_acting_pgs(unsigned int)' thread 7f2b5dfd9700 time 2021-03-09T08:40:37.725473+0000 2021-03-09T08:40:37.751 INFO:tasks.ceph.mon.a.smithi091.stderr:/build/ceph-17.0.0-1742-g89fb622b/src/osd/OSDMapMapping.h: 325: FAILED ceph_assert(osd < acting_rmap.size()) 2021-03-09T08:40:37.751 INFO:tasks.ceph.mon.a.smithi091.stderr: 2021-03-09T08:40:37.751 INFO:tasks.ceph.mon.a.smithi091.stderr: ceph version 17.0.0-1742-g89fb622b (89fb622b10ca2e58fe0c913a8956377a886e2ab4) quincy (dev) 2021-03-09T08:40:37.751 INFO:tasks.ceph.mon.a.smithi091.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f2b6a79b3dd] 2021-03-09T08:40:37.752 INFO:tasks.ceph.mon.a.smithi091.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f2b6a79b5b8] 2021-03-09T08:40:37.752 INFO:tasks.ceph.mon.a.smithi091.stderr: 3: (OSDMonitor::check_pg_num(long, int, int, int, std::ostream*)+0x4f5) [0x556f2bacfa65] 2021-03-09T08:40:37.752 INFO:tasks.ceph.mon.a.smithi091.stderr: 4: (OSDMonitor::prepare_new_pool(std::__cxx11::basic_string, std::allocator >&, int, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned int, unsigned int, unsigned long, unsigned long, float, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned long, OSDMonitor::FastReadType, std::__cxx11::basic_string, std::allocator > const&, std::ostream*)+0x551) [0x556f2bb1ba71] 2021-03-09T08:40:37.752 INFO:tasks.ceph.mon.a.smithi091.stderr: 5: (OSDMonitor::prepare_command_impl(boost::intrusive_ptr, std::map, std::allocator >, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > >, std::less, std::allocator, std::allocator > const, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > > > > > const&)+0x1e4c5) [0x556f2bb4b295] 2021-03-09T08:40:37.753 INFO:tasks.ceph.mon.a.smithi091.stderr: 6: (OSDMonitor::prepare_command(boost::intrusive_ptr)+0x10b) [0x556f2bb5324b] 2021-03-09T08:40:37.753 INFO:tasks.ceph.mon.a.smithi091.stderr: 7: (OSDMonitor::prepare_update(boost::intrusive_ptr)+0x26b) [0x556f2bb537ab] 2021-03-09T08:40:37.753 INFO:tasks.ceph.mon.a.smithi091.stderr: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0x9be) [0x556f2bac2ade] 2021-03-09T08:40:37.753 INFO:tasks.ceph.mon.a.smithi091.stderr: 9: (Monitor::handle_command(boost::intrusive_ptr)+0x47d9) [0x556f2b9adc79] 2021-03-09T08:40:37.753 INFO:tasks.ceph.mon.a.smithi091.stderr: 10: (Monitor::dispatch_op(boost::intrusive_ptr)+0x849) [0x556f2b9b1229] 2021-03-09T08:40:37.754 INFO:tasks.ceph.mon.a.smithi091.stderr: 11: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x556f2b9b266a] 2021-03-09T08:40:37.754 INFO:tasks.ceph.mon.a.smithi091.stderr: 12: (Monitor::handle_forward(boost::intrusive_ptr)+0x68f) [0x556f2b9b387f] 2021-03-09T08:40:37.754 INFO:tasks.ceph.mon.a.smithi091.stderr: 13: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1390) [0x556f2b9b1d70] 2021-03-09T08:40:37.754 INFO:tasks.ceph.mon.a.smithi091.stderr: 14: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x556f2b9b266a] 2021-03-09T08:40:37.755 INFO:tasks.ceph.mon.a.smithi091.stderr: 15: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x556f2b9e0178] 2021-03-09T08:40:37.755 INFO:tasks.ceph.mon.a.smithi091.stderr: 16: (DispatchQueue::entry()+0x11ea) [0x7f2b6a99d2ca] 2021-03-09T08:40:37.755 INFO:tasks.ceph.mon.a.smithi091.stderr: 17: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f2b6aa4771d] 2021-03-09T08:40:37.755 INFO:tasks.ceph.mon.a.smithi091.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f2b6960b6db] 2021-03-09T08:40:37.756 INFO:tasks.ceph.mon.a.smithi091.stderr: 19: clone() 2021-03-09T08:40:37.756 INFO:tasks.ceph.mon.a.smithi091.stderr: 2021-03-09T08:40:37.756 INFO:tasks.ceph.mon.a.smithi091.stderr: 0> 2021-03-09T08:40:37.736+0000 7f2b5dfd9700 -1 *** Caught signal (Aborted) ** 2021-03-09T08:40:37.756 INFO:tasks.ceph.mon.a.smithi091.stderr: in thread 7f2b5dfd9700 thread_name:ms_dispatch 2021-03-09T08:40:37.756 INFO:tasks.ceph.mon.a.smithi091.stderr: 2021-03-09T08:40:37.757 INFO:tasks.ceph.mon.a.smithi091.stderr: ceph version 17.0.0-1742-g89fb622b (89fb622b10ca2e58fe0c913a8956377a886e2ab4) quincy (dev) 2021-03-09T08:40:37.757 INFO:tasks.ceph.mon.a.smithi091.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980) [0x7f2b69616980] 2021-03-09T08:40:37.757 INFO:tasks.ceph.mon.a.smithi091.stderr: 2: gsignal() 2021-03-09T08:40:37.757 INFO:tasks.ceph.mon.a.smithi091.stderr: 3: abort() 2021-03-09T08:40:37.758 INFO:tasks.ceph.mon.a.smithi091.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x19c) [0x7f2b6a79b42e] 2021-03-09T08:40:37.758 INFO:tasks.ceph.mon.a.smithi091.stderr: 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f2b6a79b5b8] 2021-03-09T08:40:37.758 INFO:tasks.ceph.mon.a.smithi091.stderr: 6: (OSDMonitor::check_pg_num(long, int, int, int, std::ostream*)+0x4f5) [0x556f2bacfa65] 2021-03-09T08:40:37.758 INFO:tasks.ceph.mon.a.smithi091.stderr: 7: (OSDMonitor::prepare_new_pool(std::__cxx11::basic_string, std::allocator >&, int, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned int, unsigned int, unsigned long, unsigned long, float, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned long, OSDMonitor::FastReadType, std::__cxx11::basic_string, std::allocator > const&, std::ostream*)+0x551) [0x556f2bb1ba71] 2021-03-09T08:40:37.758 INFO:tasks.ceph.mon.a.smithi091.stderr: 8: (OSDMonitor::prepare_command_impl(boost::intrusive_ptr, std::map, std::allocator >, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > >, std::less, std::allocator, std::allocator > const, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > > > > > const&)+0x1e4c5) [0x556f2bb4b295] 2021-03-09T08:40:37.759 INFO:tasks.ceph.mon.a.smithi091.stderr: 9: (OSDMonitor::prepare_command(boost::intrusive_ptr)+0x10b) [0x556f2bb5324b] 2021-03-09T08:40:37.759 INFO:tasks.ceph.mon.a.smithi091.stderr: 10: (OSDMonitor::prepare_update(boost::intrusive_ptr)+0x26b) [0x556f2bb537ab] 2021-03-09T08:40:37.759 INFO:tasks.ceph.mon.a.smithi091.stderr: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0x9be) [0x556f2bac2ade] 2021-03-09T08:40:37.759 INFO:tasks.ceph.mon.a.smithi091.stderr: 12: (Monitor::handle_command(boost::intrusive_ptr)+0x47d9) [0x556f2b9adc79] 2021-03-09T08:40:37.760 INFO:tasks.ceph.mon.a.smithi091.stderr: 13: (Monitor::dispatch_op(boost::intrusive_ptr)+0x849) [0x556f2b9b1229] 2021-03-09T08:40:37.760 INFO:tasks.ceph.mon.a.smithi091.stderr: 14: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x556f2b9b266a] 2021-03-09T08:40:37.760 INFO:tasks.ceph.mon.a.smithi091.stderr: 15: (Monitor::handle_forward(boost::intrusive_ptr)+0x68f) [0x556f2b9b387f] 2021-03-09T08:40:37.760 INFO:tasks.ceph.mon.a.smithi091.stderr: 16: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1390) [0x556f2b9b1d70] 2021-03-09T08:40:37.760 INFO:tasks.ceph.mon.a.smithi091.stderr: 17: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x556f2b9b266a] 2021-03-09T08:40:37.761 INFO:tasks.ceph.mon.a.smithi091.stderr: 18: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x556f2b9e0178] 2021-03-09T08:40:37.761 INFO:tasks.ceph.mon.a.smithi091.stderr: 19: (DispatchQueue::entry()+0x11ea) [0x7f2b6a99d2ca] 2021-03-09T08:40:37.761 INFO:tasks.ceph.mon.a.smithi091.stderr: 20: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f2b6aa4771d] 2021-03-09T08:40:37.761 INFO:tasks.ceph.mon.a.smithi091.stderr: 21: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f2b6960b6db] 2021-03-09T08:40:37.762 INFO:tasks.ceph.mon.a.smithi091.stderr: 22: clone() 2021-03-09T08:40:37.762 INFO:tasks.ceph.mon.a.smithi091.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-03-09T08:40:37.762 INFO:tasks.ceph.mon.a.smithi091.stderr: 2021-03-09T08:40:37.769 INFO:tasks.ceph.mon.a.smithi091.stderr: -1> 2021-03-09T08:40:37.728+0000 7f2b5dfd9700 -1 /build/ceph-17.0.0-1742-g89fb622b/src/osd/OSDMapMapping.h: In function 'mempool::osdmap_mapping::vector& OSDMapMapping::get_osd_acting_pgs(unsigned int)' thread 7f2b5dfd9700 time 2021-03-09T08:40:37.725473+0000 2021-03-09T08:40:37.769 INFO:tasks.ceph.mon.a.smithi091.stderr:/build/ceph-17.0.0-1742-g89fb622b/src/osd/OSDMapMapping.h: 325: FAILED ceph_assert(osd < acting_rmap.size()) 2021-03-09T08:40:37.769 INFO:tasks.ceph.mon.a.smithi091.stderr: 2021-03-09T08:40:37.770 INFO:tasks.ceph.mon.a.smithi091.stderr: ceph version 17.0.0-1742-g89fb622b (89fb622b10ca2e58fe0c913a8956377a886e2ab4) quincy (dev) 2021-03-09T08:40:37.770 INFO:tasks.ceph.mon.a.smithi091.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f2b6a79b3dd] 2021-03-09T08:40:37.770 INFO:tasks.ceph.mon.a.smithi091.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f2b6a79b5b8] 2021-03-09T08:40:37.770 INFO:tasks.ceph.mon.a.smithi091.stderr: 3: (OSDMonitor::check_pg_num(long, int, int, int, std::ostream*)+0x4f5) [0x556f2bacfa65] 2021-03-09T08:40:37.771 INFO:tasks.ceph.mon.a.smithi091.stderr: 4: (OSDMonitor::prepare_new_pool(std::__cxx11::basic_string, std::allocator >&, int, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned int, unsigned int, unsigned long, unsigned long, float, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned long, OSDMonitor::FastReadType, std::__cxx11::basic_string, std::allocator > const&, std::ostream*)+0x551) [0x556f2bb1ba71] 2021-03-09T08:40:37.771 INFO:tasks.ceph.mon.a.smithi091.stderr: 5: (OSDMonitor::prepare_command_impl(boost::intrusive_ptr, std::map, std::allocator >, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > >, std::less, std::allocator, std::allocator > const, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > > > > > const&)+0x1e4c5) [0x556f2bb4b295] 2021-03-09T08:40:37.771 INFO:tasks.ceph.mon.a.smithi091.stderr: 6: (OSDMonitor::prepare_command(boost::intrusive_ptr)+0x10b) [0x556f2bb5324b] 2021-03-09T08:40:37.771 INFO:tasks.ceph.mon.a.smithi091.stderr: 7: (OSDMonitor::prepare_update(boost::intrusive_ptr)+0x26b) [0x556f2bb537ab] 2021-03-09T08:40:37.772 INFO:tasks.ceph.mon.a.smithi091.stderr: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0x9be) [0x556f2bac2ade] 2021-03-09T08:40:37.772 INFO:tasks.ceph.mon.a.smithi091.stderr: 9: (Monitor::handle_command(boost::intrusive_ptr)+0x47d9) [0x556f2b9adc79] 2021-03-09T08:40:37.772 INFO:tasks.ceph.mon.a.smithi091.stderr: 10: (Monitor::dispatch_op(boost::intrusive_ptr)+0x849) [0x556f2b9b1229] 2021-03-09T08:40:37.772 INFO:tasks.ceph.mon.a.smithi091.stderr: 11: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x556f2b9b266a] 2021-03-09T08:40:37.773 INFO:tasks.ceph.mon.a.smithi091.stderr: 12: (Monitor::handle_forward(boost::intrusive_ptr)+0x68f) [0x556f2b9b387f] 2021-03-09T08:40:37.773 INFO:tasks.ceph.mon.a.smithi091.stderr: 13: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1390) [0x556f2b9b1d70] 2021-03-09T08:40:37.773 INFO:tasks.ceph.mon.a.smithi091.stderr: 14: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x556f2b9b266a] 2021-03-09T08:40:37.774 INFO:tasks.ceph.mon.a.smithi091.stderr: 15: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x556f2b9e0178] 2021-03-09T08:40:37.774 INFO:tasks.ceph.mon.a.smithi091.stderr: 16: (DispatchQueue::entry()+0x11ea) [0x7f2b6a99d2ca] 2021-03-09T08:40:37.774 INFO:tasks.ceph.mon.a.smithi091.stderr: 17: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f2b6aa4771d] 2021-03-09T08:40:37.774 INFO:tasks.ceph.mon.a.smithi091.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f2b6960b6db] 2021-03-09T08:40:37.775 INFO:tasks.ceph.mon.a.smithi091.stderr: 19: clone() 2021-03-09T08:40:37.775 INFO:tasks.ceph.mon.a.smithi091.stderr: 2021-03-09T08:40:37.775 INFO:tasks.ceph.mon.a.smithi091.stderr: 0> 2021-03-09T08:40:37.736+0000 7f2b5dfd9700 -1 *** Caught signal (Aborted) ** 2021-03-09T08:40:37.776 INFO:tasks.ceph.mon.a.smithi091.stderr: in thread 7f2b5dfd9700 thread_name:ms_dispatch 2021-03-09T08:40:37.776 INFO:tasks.ceph.mon.a.smithi091.stderr: 2021-03-09T08:40:37.776 INFO:tasks.ceph.mon.a.smithi091.stderr: ceph version 17.0.0-1742-g89fb622b (89fb622b10ca2e58fe0c913a8956377a886e2ab4) quincy (dev) 2021-03-09T08:40:37.776 INFO:tasks.ceph.mon.a.smithi091.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980) [0x7f2b69616980] 2021-03-09T08:40:37.777 INFO:tasks.ceph.mon.a.smithi091.stderr: 2: gsignal() 2021-03-09T08:40:37.777 INFO:tasks.ceph.mon.a.smithi091.stderr: 3: abort() 2021-03-09T08:40:37.777 INFO:tasks.ceph.mon.a.smithi091.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x19c) [0x7f2b6a79b42e] 2021-03-09T08:40:37.777 INFO:tasks.ceph.mon.a.smithi091.stderr: 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f2b6a79b5b8] 2021-03-09T08:40:37.778 INFO:tasks.ceph.mon.a.smithi091.stderr: 6: (OSDMonitor::check_pg_num(long, int, int, int, std::ostream*)+0x4f5) [0x556f2bacfa65] 2021-03-09T08:40:37.778 INFO:tasks.ceph.mon.a.smithi091.stderr: 7: (OSDMonitor::prepare_new_pool(std::__cxx11::basic_string, std::allocator >&, int, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned int, unsigned int, unsigned long, unsigned long, float, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned long, OSDMonitor::FastReadType, std::__cxx11::basic_string, std::allocator > const&, std::ostream*)+0x551) [0x556f2bb1ba71] 2021-03-09T08:40:37.778 INFO:tasks.ceph.mon.a.smithi091.stderr: 8: (OSDMonitor::prepare_command_impl(boost::intrusive_ptr, std::map, std::allocator >, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > >, std::less, std::allocator, std::allocator > const, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > > > > > const&)+0x1e4c5) [0x556f2bb4b295] 2021-03-09T08:40:37.779 INFO:tasks.ceph.mon.a.smithi091.stderr: 9: (OSDMonitor::prepare_command(boost::intrusive_ptr)+0x10b) [0x556f2bb5324b] 2021-03-09T08:40:37.779 INFO:tasks.ceph.mon.a.smithi091.stderr: 10: (OSDMonitor::prepare_update(boost::intrusive_ptr)+0x26b) [0x556f2bb537ab] 2021-03-09T08:40:37.779 INFO:tasks.ceph.mon.a.smithi091.stderr: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0x9be) [0x556f2bac2ade] 2021-03-09T08:40:37.779 INFO:tasks.ceph.mon.a.smithi091.stderr: 12: (Monitor::handle_command(boost::intrusive_ptr)+0x47d9) [0x556f2b9adc79] 2021-03-09T08:40:37.780 INFO:tasks.ceph.mon.a.smithi091.stderr: 13: (Monitor::dispatch_op(boost::intrusive_ptr)+0x849) [0x556f2b9b1229] 2021-03-09T08:40:37.780 INFO:tasks.ceph.mon.a.smithi091.stderr: 14: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x556f2b9b266a] 2021-03-09T08:40:37.780 INFO:tasks.ceph.mon.a.smithi091.stderr: 15: (Monitor::handle_forward(boost::intrusive_ptr)+0x68f) [0x556f2b9b387f] 2021-03-09T08:40:37.781 INFO:tasks.ceph.mon.a.smithi091.stderr: 16: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1390) [0x556f2b9b1d70] 2021-03-09T08:40:37.781 INFO:tasks.ceph.mon.a.smithi091.stderr: 17: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x556f2b9b266a] 2021-03-09T08:40:37.781 INFO:tasks.ceph.mon.a.smithi091.stderr: 18: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x556f2b9e0178] 2021-03-09T08:40:37.782 INFO:tasks.ceph.mon.a.smithi091.stderr: 19: (DispatchQueue::entry()+0x11ea) [0x7f2b6a99d2ca] 2021-03-09T08:40:37.782 INFO:tasks.ceph.mon.a.smithi091.stderr: 20: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f2b6aa4771d] 2021-03-09T08:40:37.782 INFO:tasks.ceph.mon.a.smithi091.stderr: 21: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f2b6960b6db] 2021-03-09T08:40:37.782 INFO:tasks.ceph.mon.a.smithi091.stderr: 22: clone() 2021-03-09T08:40:37.783 INFO:tasks.ceph.mon.a.smithi091.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-03-09T08:40:37.783 INFO:tasks.ceph.mon.a.smithi091.stderr: 2021-03-09T08:40:38.456 INFO:tasks.ceph.mon.a.smithi091.stderr:daemon-helper: command crashed with signal 6 2021-03-09T08:40:38.519 DEBUG:teuthology.orchestra.run.smithi091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-03-09T08:40:38.701 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e5e316700 1 Processor -- start 2021-03-09T08:40:38.702 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e5e316700 1 -- start start 2021-03-09T08:40:38.703 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e5e316700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e580aa1b0 con 0x7f4e58068680 2021-03-09T08:40:38.703 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e5e316700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e58132b50 con 0x7f4e580668c0 2021-03-09T08:40:38.703 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e5e316700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e580a5dc0 con 0x7f4e580a9dd0 2021-03-09T08:40:38.703 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e5db15700 1 -- >> v1:172.21.15.91:6789/0 conn(0x7f4e58068680 legacy=0x7f4e58132440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:40:38.704 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e5d314700 1 --1- >> v1:172.21.15.91:6790/0 conn(0x7f4e580a9dd0 0x7f4e58067f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6790/0 says I am v1:172.21.15.91:50352/0 (socket says 172.21.15.91:50352) 2021-03-09T08:40:38.704 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e5d314700 1 -- 172.21.15.91:0/2345089451 learned_addr learned my addr 172.21.15.91:0/2345089451 (peer_addr_for_me v1:172.21.15.91:0/0) 2021-03-09T08:40:38.706 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e4bfff700 1 -- 172.21.15.91:0/2345089451 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268814395 0 0) 0x7f4e580a5dc0 con 0x7f4e580a9dd0 2021-03-09T08:40:38.706 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e4bfff700 1 -- 172.21.15.91:0/2345089451 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e40003230 con 0x7f4e580a9dd0 2021-03-09T08:40:38.706 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e4bfff700 1 -- 172.21.15.91:0/2345089451 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344623925 0 0) 0x7f4e58132b50 con 0x7f4e580668c0 2021-03-09T08:40:38.707 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e4bfff700 1 -- 172.21.15.91:0/2345089451 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e580a5dc0 con 0x7f4e580668c0 2021-03-09T08:40:38.707 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e4bfff700 1 -- 172.21.15.91:0/2345089451 <== mon.2 v1:172.21.15.91:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1398277103 0 0) 0x7f4e40003230 con 0x7f4e580a9dd0 2021-03-09T08:40:38.707 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e4bfff700 1 -- 172.21.15.91:0/2345089451 >> v1:172.21.15.106:6789/0 conn(0x7f4e580668c0 legacy=0x7f4e58131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:38.707 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e4bfff700 1 -- 172.21.15.91:0/2345089451 >> v1:172.21.15.91:6789/0 conn(0x7f4e58068680 legacy=0x7f4e58132440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-03-09T08:40:38.707 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e4bfff700 1 -- 172.21.15.91:0/2345089451 --> v1:172.21.15.91:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e580a5700 con 0x7f4e580a9dd0 2021-03-09T08:40:38.708 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e4bfff700 1 -- 172.21.15.91:0/2345089451 <== mon.2 v1:172.21.15.91:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f4e4c001680 con 0x7f4e580a9dd0 2021-03-09T08:40:38.708 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e4bfff700 1 -- 172.21.15.91:0/2345089451 <== mon.2 v1:172.21.15.91:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4e4c001960 con 0x7f4e580a9dd0 2021-03-09T08:40:38.708 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.704+0000 7f4e4bfff700 1 -- 172.21.15.91:0/2345089451 <== mon.2 v1:172.21.15.91:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f4e4c001cf0 con 0x7f4e580a9dd0 2021-03-09T08:40:38.708 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.708+0000 7f4e5e316700 1 -- 172.21.15.91:0/2345089451 >> v1:172.21.15.91:6790/0 conn(0x7f4e580a9dd0 legacy=0x7f4e58067f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:38.709 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.708+0000 7f4e5e316700 1 -- 172.21.15.91:0/2345089451 shutdown_connections 2021-03-09T08:40:38.709 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.708+0000 7f4e5e316700 1 -- 172.21.15.91:0/2345089451 >> 172.21.15.91:0/2345089451 conn(0x7f4e58062900 msgr2=0x7f4e580a9520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:38.709 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.708+0000 7f4e5e316700 1 -- 172.21.15.91:0/2345089451 shutdown_connections 2021-03-09T08:40:38.709 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.708+0000 7f4e5e316700 1 -- 172.21.15.91:0/2345089451 wait complete. 2021-03-09T08:40:38.711 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.708+0000 7f4e5e316700 1 Processor -- start 2021-03-09T08:40:38.712 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.708+0000 7f4e5e316700 1 -- start start 2021-03-09T08:40:38.712 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.708+0000 7f4e5d314700 1 -- >> v1:172.21.15.91:6789/0 conn(0x7f4e580668c0 legacy=0x7f4e58130bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:40:38.712 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.708+0000 7f4e5e316700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5809f160 con 0x7f4e580668c0 2021-03-09T08:40:38.712 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.708+0000 7f4e5e316700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e581319b0 con 0x7f4e58068680 2021-03-09T08:40:38.713 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.708+0000 7f4e5e316700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5809ed30 con 0x7f4e580a9dd0 2021-03-09T08:40:38.713 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.708+0000 7f4e5db15700 1 --1- >> v1:172.21.15.91:6790/0 conn(0x7f4e580a9dd0 0x7f4e5814cfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.91:6790/0 says I am v1:172.21.15.91:50362/0 (socket says 172.21.15.91:50362) 2021-03-09T08:40:38.713 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.708+0000 7f4e5db15700 1 -- 172.21.15.91:0/1332629733 learned_addr learned my addr 172.21.15.91:0/1332629733 (peer_addr_for_me v1:172.21.15.91:0/0) 2021-03-09T08:40:38.713 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.712+0000 7f4e497fa700 1 -- 172.21.15.91:0/1332629733 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763815913 0 0) 0x7f4e5809ed30 con 0x7f4e580a9dd0 2021-03-09T08:40:38.713 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.712+0000 7f4e497fa700 1 -- 172.21.15.91:0/1332629733 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e38003230 con 0x7f4e580a9dd0 2021-03-09T08:40:38.714 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.712+0000 7f4e497fa700 1 -- 172.21.15.91:0/1332629733 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120485753 0 0) 0x7f4e581319b0 con 0x7f4e58068680 2021-03-09T08:40:38.714 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.712+0000 7f4e497fa700 1 -- 172.21.15.91:0/1332629733 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e5809ed30 con 0x7f4e58068680 2021-03-09T08:40:38.714 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.712+0000 7f4e497fa700 1 -- 172.21.15.91:0/1332629733 <== mon.2 v1:172.21.15.91:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3421161141 0 0) 0x7f4e38003230 con 0x7f4e580a9dd0 2021-03-09T08:40:38.714 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.712+0000 7f4e497fa700 1 -- 172.21.15.91:0/1332629733 --> v1:172.21.15.91:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4e581319b0 con 0x7f4e580a9dd0 2021-03-09T08:40:38.715 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.712+0000 7f4e497fa700 1 -- 172.21.15.91:0/1332629733 <== mon.2 v1:172.21.15.91:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f4e50003df0 con 0x7f4e580a9dd0 2021-03-09T08:40:38.715 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.712+0000 7f4e497fa700 1 -- 172.21.15.91:0/1332629733 <== mon.2 v1:172.21.15.91:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2037896298 0 0) 0x7f4e581319b0 con 0x7f4e580a9dd0 2021-03-09T08:40:38.715 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.712+0000 7f4e497fa700 1 -- 172.21.15.91:0/1332629733 >> v1:172.21.15.106:6789/0 conn(0x7f4e58068680 legacy=0x7f4e58135210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:38.715 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.712+0000 7f4e497fa700 1 -- 172.21.15.91:0/1332629733 >> v1:172.21.15.91:6789/0 conn(0x7f4e580668c0 legacy=0x7f4e58130bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:40:38.715 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.712+0000 7f4e497fa700 1 -- 172.21.15.91:0/1332629733 --> v1:172.21.15.91:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5809eec0 con 0x7f4e580a9dd0 2021-03-09T08:40:38.716 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.712+0000 7f4e5e316700 1 -- 172.21.15.91:0/1332629733 --> v1:172.21.15.91:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5809fd20 con 0x7f4e580a9dd0 2021-03-09T08:40:38.716 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.712+0000 7f4e5e316700 1 -- 172.21.15.91:0/1332629733 --> v1:172.21.15.91:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e58135ac0 con 0x7f4e580a9dd0 2021-03-09T08:40:38.717 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.712+0000 7f4e497fa700 1 -- 172.21.15.91:0/1332629733 <== mon.2 v1:172.21.15.91:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4e50004060 con 0x7f4e580a9dd0 2021-03-09T08:40:38.717 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.712+0000 7f4e497fa700 1 -- 172.21.15.91:0/1332629733 <== mon.2 v1:172.21.15.91:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7f4e500043f0 con 0x7f4e580a9dd0 2021-03-09T08:40:38.717 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.712+0000 7f4e5e316700 1 -- 172.21.15.91:0/1332629733 --> v1:172.21.15.91:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e30004d50 con 0x7f4e580a9dd0 2021-03-09T08:40:38.718 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.712+0000 7f4e497fa700 1 -- 172.21.15.91:0/1332629733 <== mon.2 v1:172.21.15.91:6790/0 7 ==== mgrmap(e 4) v1 ==== 69396+0+0 (unknown 2916148426 0 0) 0x7f4e500045d0 con 0x7f4e580a9dd0 2021-03-09T08:40:38.718 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.716+0000 7f4e497fa700 1 -- 172.21.15.91:0/1332629733 <== mon.2 v1:172.21.15.91:6790/0 8 ==== osd_map(13..13 src has 1..13) v4 ==== 3380+0+0 (unknown 4093344796 0 0) 0x7f4e5006d000 con 0x7f4e580a9dd0 2021-03-09T08:40:38.718 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.716+0000 7f4e497fa700 1 -- 172.21.15.91:0/1332629733 <== mon.2 v1:172.21.15.91:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (unknown 1092875540 0 1865811669) 0x7f4e50041970 con 0x7f4e580a9dd0 2021-03-09T08:40:38.869 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.872+0000 7f4e5e316700 1 -- 172.21.15.91:0/1332629733 --> v1:172.21.15.91:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e30005000 con 0x7f4e580a9dd0 2021-03-09T08:40:38.871 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.872+0000 7f4e497fa700 1 -- 172.21.15.91:0/1332629733 <== mon.2 v1:172.21.15.91:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8630 (unknown 62554612 0 4111011936) 0x7f4e50043a70 con 0x7f4e580a9dd0 2021-03-09T08:40:38.871 INFO:teuthology.misc.health.smithi091.stdout: 2021-03-09T08:40:38.871 INFO:teuthology.misc.health.smithi091.stdout:{"epoch":13,"fsid":"e6444b40-8694-46ba-959c-a5e888845ea5","created":"2021-03-09T08:40:27.549021+0000","modified":"2021-03-09T08:40:37.658650+0000","last_up_change":"2021-03-09T08:40:37.658650+0000","last_in_change":"2021-03-09T08:40:30.603939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"d320711c-c382-48d3-bde9-d4787c3c1b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.91:6812","nonce":17875}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.91:6813","nonce":17875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.91:6815","nonce":17875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.91:6814","nonce":17875}]},"public_addr":"172.21.15.91:6812/17875","cluster_addr":"172.21.15.91:6813/17875","heartbeat_back_addr":"172.21.15.91:6815/17875","heartbeat_front_addr":"172.21.15.91:6814/17875","state":["exists","up"]},{"osd":1,"uuid":"985e5655-b76d-408a-8029-06d21a1e4034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.91:6808","nonce":17874}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.91:6809","nonce":17874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.91:6811","nonce":17874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.91:6810","nonce":17874}]},"public_addr":"172.21.15.91:6808/17874","cluster_addr":"172.21.15.91:6809/17874","heartbeat_back_addr":"172.21.15.91:6811/17874","heartbeat_front_addr":"172.21.15.91:6810/17874","state":["exists","up"]},{"osd":2,"uuid":"9e2a9318-2469-4fbf-a6d9-2c8a5977839f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.91:6800","nonce":17872}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.91:6801","nonce":17872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.91:6805","nonce":17872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.91:6803","nonce":17872}]},"public_addr":"172.21.15.91:6800/17872","cluster_addr":"172.21.15.91:6801/17872","heartbeat_back_addr":"172.21.15.91:6805/17872","heartbeat_front_addr":"172.21.15.91:6803/17872","state":["exists","up"]},{"osd":3,"uuid":"f8d9be67-32be-4716-a240-d768d5a50465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.91:6802","nonce":17873}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.91:6804","nonce":17873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.91:6807","nonce":17873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.91:6806","nonce":17873}]},"public_addr":"172.21.15.91:6802/17873","cluster_addr":"172.21.15.91:6804/17873","heartbeat_back_addr":"172.21.15.91:6807/17873","heartbeat_front_addr":"172.21.15.91:6806/17873","state":["exists","up"]},{"osd":4,"uuid":"23c43fc1-8b3e-4e3b-b710-a638544f04fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6804","nonce":17834}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6805","nonce":17834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6807","nonce":17834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6806","nonce":17834}]},"public_addr":"172.21.15.106:6804/17834","cluster_addr":"172.21.15.106:6805/17834","heartbeat_back_addr":"172.21.15.106:6807/17834","heartbeat_front_addr":"172.21.15.106:6806/17834","state":["exists","up"]},{"osd":5,"uuid":"8ced66cb-bff4-4e6d-bbdb-825f34496f8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6800","nonce":17836}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6801","nonce":17836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6803","nonce":17836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6802","nonce":17836}]},"public_addr":"172.21.15.106:6800/17836","cluster_addr":"172.21.15.106:6801/17836","heartbeat_back_addr":"172.21.15.106:6803/17836","heartbeat_front_addr":"172.21.15.106:6802/17836","state":["exists","up"]},{"osd":6,"uuid":"e5ffeaee-5262-41b6-b548-5d1a476feaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6808","nonce":17835}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6810","nonce":17835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6814","nonce":17835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6812","nonce":17835}]},"public_addr":"172.21.15.106:6808/17835","cluster_addr":"172.21.15.106:6810/17835","heartbeat_back_addr":"172.21.15.106:6814/17835","heartbeat_front_addr":"172.21.15.106:6812/17835","state":["exists","up"]},{"osd":7,"uuid":"52260ac7-2d7c-41b0-88bc-9309cceccc7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6809","nonce":17838}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6811","nonce":17838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6815","nonce":17838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6813","nonce":17838}]},"public_addr":"172.21.15.106:6809/17838","cluster_addr":"172.21.15.106:6811/17838","heartbeat_back_addr":"172.21.15.106:6815/17838","heartbeat_front_addr":"172.21.15.106:6813/17838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-03-09T08:40:38.873 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.876+0000 7f4e5e316700 1 -- 172.21.15.91:0/1332629733 >> v1:172.21.15.91:6816/17701 conn(0x7f4e380595f0 legacy=0x7f4e3805bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:38.874 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.876+0000 7f4e5e316700 1 -- 172.21.15.91:0/1332629733 >> v1:172.21.15.91:6790/0 conn(0x7f4e580a9dd0 legacy=0x7f4e5814cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:38.874 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.876+0000 7f4e5e316700 1 -- 172.21.15.91:0/1332629733 shutdown_connections 2021-03-09T08:40:38.874 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.876+0000 7f4e5e316700 1 -- 172.21.15.91:0/1332629733 >> 172.21.15.91:0/1332629733 conn(0x7f4e58062900 msgr2=0x7f4e5805cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:38.874 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.876+0000 7f4e5e316700 1 -- 172.21.15.91:0/1332629733 shutdown_connections 2021-03-09T08:40:38.875 INFO:teuthology.misc.health.smithi091.stderr:2021-03-09T08:40:38.876+0000 7f4e5e316700 1 -- 172.21.15.91:0/1332629733 wait complete. 2021-03-09T08:40:38.893 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-03-09T08:40:38.893 INFO:tasks.ceph:Creating RBD pool 2021-03-09T08:40:38.894 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd pool create rbd 8 2021-03-09T08:40:39.078 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.080+0000 7fdd49aa3700 1 Processor -- start 2021-03-09T08:40:39.079 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.080+0000 7fdd49aa3700 1 -- start start 2021-03-09T08:40:39.081 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.080+0000 7fdd49aa3700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd440622e0 con 0x7fdd44061f00 2021-03-09T08:40:39.081 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.080+0000 7fdd49aa3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd440a4850 con 0x7fdd44133680 2021-03-09T08:40:39.082 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.080+0000 7fdd48aa1700 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fdd44061f00 legacy=0x7fdd44132f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:40:39.082 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.080+0000 7fdd49aa3700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd440a0640 con 0x7fdd440a0100 2021-03-09T08:40:39.082 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.080+0000 7fdd43fff700 1 --1- >> v1:172.21.15.91:6790/0 conn(0x7fdd440a0100 0x7fdd44067fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6790/0 says I am v1:172.21.15.91:50368/0 (socket says 172.21.15.91:50368) 2021-03-09T08:40:39.083 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.080+0000 7fdd43fff700 1 -- 172.21.15.91:0/1964160674 learned_addr learned my addr 172.21.15.91:0/1964160674 (peer_addr_for_me v1:172.21.15.91:0/0) 2021-03-09T08:40:39.083 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.080+0000 7fdd437fe700 1 -- 172.21.15.91:0/1964160674 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748569197 0 0) 0x7fdd440a0640 con 0x7fdd440a0100 2021-03-09T08:40:39.084 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.080+0000 7fdd437fe700 1 -- 172.21.15.91:0/1964160674 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd30003230 con 0x7fdd440a0100 2021-03-09T08:40:39.084 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.080+0000 7fdd437fe700 1 -- 172.21.15.91:0/1964160674 <== mon.2 v1:172.21.15.91:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 567800009 0 0) 0x7fdd30003230 con 0x7fdd440a0100 2021-03-09T08:40:39.084 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.080+0000 7fdd437fe700 1 -- 172.21.15.91:0/1964160674 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd4413e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:39.084 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.080+0000 7fdd437fe700 1 -- 172.21.15.91:0/1964160674 >> v1:172.21.15.91:6789/0 conn(0x7fdd44061f00 legacy=0x7fdd44132f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-03-09T08:40:39.085 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.080+0000 7fdd437fe700 1 -- 172.21.15.91:0/1964160674 --> v1:172.21.15.91:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd440a0ae0 con 0x7fdd440a0100 2021-03-09T08:40:39.085 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.080+0000 7fdd437fe700 1 -- 172.21.15.91:0/1964160674 <== mon.2 v1:172.21.15.91:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fdd38001680 con 0x7fdd440a0100 2021-03-09T08:40:39.085 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.080+0000 7fdd437fe700 1 -- 172.21.15.91:0/1964160674 <== mon.2 v1:172.21.15.91:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fdd380019a0 con 0x7fdd440a0100 2021-03-09T08:40:39.085 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.080+0000 7fdd437fe700 1 -- 172.21.15.91:0/1964160674 <== mon.2 v1:172.21.15.91:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fdd38001d30 con 0x7fdd440a0100 2021-03-09T08:40:39.085 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.084+0000 7fdd49aa3700 1 -- 172.21.15.91:0/1964160674 >> v1:172.21.15.91:6790/0 conn(0x7fdd440a0100 legacy=0x7fdd44067fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:39.086 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.084+0000 7fdd49aa3700 1 -- 172.21.15.91:0/1964160674 shutdown_connections 2021-03-09T08:40:39.086 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.084+0000 7fdd49aa3700 1 -- 172.21.15.91:0/1964160674 >> 172.21.15.91:0/1964160674 conn(0x7fdd440a9750 msgr2=0x7fdd440a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-03-09T08:40:39.086 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.084+0000 7fdd49aa3700 1 -- 172.21.15.91:0/1964160674 shutdown_connections 2021-03-09T08:40:39.086 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.084+0000 7fdd49aa3700 1 -- 172.21.15.91:0/1964160674 wait complete. 2021-03-09T08:40:39.090 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.084+0000 7fdd49aa3700 1 Processor -- start 2021-03-09T08:40:39.090 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.084+0000 7fdd49aa3700 1 -- start start 2021-03-09T08:40:39.091 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.084+0000 7fdd49aa3700 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd44143bb0 con 0x7fdd44061f00 2021-03-09T08:40:39.091 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.084+0000 7fdd49aa3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd44144760 con 0x7fdd44133680 2021-03-09T08:40:39.091 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.084+0000 7fdd49aa3700 1 -- --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd441438e0 con 0x7fdd44064d50 2021-03-09T08:40:39.091 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.084+0000 7fdd48aa1700 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fdd44061f00 legacy=0x7fdd44135f90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:40:39.092 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.084+0000 7fdd492a2700 1 --1- >> v1:172.21.15.91:6790/0 conn(0x7fdd44064d50 0x7fdd44144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.91:6790/0 says I am v1:172.21.15.91:50376/0 (socket says 172.21.15.91:50376) 2021-03-09T08:40:39.092 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.084+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 learned_addr learned my addr 172.21.15.91:0/2882157385 (peer_addr_for_me v1:172.21.15.91:0/0) 2021-03-09T08:40:39.092 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.084+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 <== mon.2 v1:172.21.15.91:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214918687 0 0) 0x7fdd441438e0 con 0x7fdd44064d50 2021-03-09T08:40:39.092 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.084+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd24003230 con 0x7fdd44064d50 2021-03-09T08:40:39.092 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.088+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 <== mon.2 v1:172.21.15.91:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2282236845 0 0) 0x7fdd24003230 con 0x7fdd44064d50 2021-03-09T08:40:39.093 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.088+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdd441438e0 con 0x7fdd44064d50 2021-03-09T08:40:39.093 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.088+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388840281 0 0) 0x7fdd44144760 con 0x7fdd44133680 2021-03-09T08:40:39.093 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.088+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd24003230 con 0x7fdd44133680 2021-03-09T08:40:39.093 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.088+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 <== mon.2 v1:172.21.15.91:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fdd3c001890 con 0x7fdd44064d50 2021-03-09T08:40:39.094 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.088+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 <== mon.2 v1:172.21.15.91:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2948298713 0 0) 0x7fdd441438e0 con 0x7fdd44064d50 2021-03-09T08:40:39.094 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.088+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd44111a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:40:39.094 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.088+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd44061f00 legacy=0x7fdd44135f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:40:39.094 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.088+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd44065530 con 0x7fdd44064d50 2021-03-09T08:40:39.094 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.088+0000 7fdd49aa3700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd44065800 con 0x7fdd44064d50 2021-03-09T08:40:39.095 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.088+0000 7fdd49aa3700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd44065cd0 con 0x7fdd44064d50 2021-03-09T08:40:39.095 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.088+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 <== mon.2 v1:172.21.15.91:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fdd3c001c60 con 0x7fdd44064d50 2021-03-09T08:40:39.095 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.088+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 <== mon.2 v1:172.21.15.91:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2803232592 0 0) 0x7fdd3c0023e0 con 0x7fdd44064d50 2021-03-09T08:40:39.095 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.088+0000 7fdd49aa3700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1c004d60 con 0x7fdd44064d50 2021-03-09T08:40:39.096 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.088+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 <== mon.2 v1:172.21.15.91:6790/0 7 ==== mgrmap(e 4) v1 ==== 69396+0+0 (unknown 2916148426 0 0) 0x7fdd3c0025c0 con 0x7fdd44064d50 2021-03-09T08:40:39.096 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.088+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 <== mon.2 v1:172.21.15.91:6790/0 8 ==== osd_map(13..13 src has 1..13) v4 ==== 3380+0+0 (unknown 4093344796 0 0) 0x7fdd3c06d000 con 0x7fdd44064d50 2021-03-09T08:40:39.097 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.096+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 <== mon.2 v1:172.21.15.91:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149001 (unknown 1092875540 0 1865811669) 0x7fdd3c041b40 con 0x7fdd44064d50 2021-03-09T08:40:39.253 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:40:39.252+0000 7fdd49aa3700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fdd1c005590 con 0x7fdd44064d50 2021-03-09T08:40:52.743 INFO:tasks.ceph.mon.b.smithi106.stderr:/build/ceph-17.0.0-1742-g89fb622b/src/osd/OSDMapMapping.h: In function 'mempool::osdmap_mapping::vector& OSDMapMapping::get_osd_acting_pgs(unsigned int)' thread 7f99bf591700 time 2021-03-09T08:40:52.747593+0000 2021-03-09T08:40:52.744 INFO:tasks.ceph.mon.b.smithi106.stderr:/build/ceph-17.0.0-1742-g89fb622b/src/osd/OSDMapMapping.h: 325: FAILED ceph_assert(osd < acting_rmap.size()) 2021-03-09T08:40:52.759 INFO:tasks.ceph.mon.b.smithi106.stderr: ceph version 17.0.0-1742-g89fb622b (89fb622b10ca2e58fe0c913a8956377a886e2ab4) quincy (dev) 2021-03-09T08:40:52.760 INFO:tasks.ceph.mon.b.smithi106.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f99cbd533dd] 2021-03-09T08:40:52.760 INFO:tasks.ceph.mon.b.smithi106.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f99cbd535b8] 2021-03-09T08:40:52.760 INFO:tasks.ceph.mon.b.smithi106.stderr: 3: (OSDMonitor::check_pg_num(long, int, int, int, std::ostream*)+0x4f5) [0x55ffaee57a65] 2021-03-09T08:40:52.761 INFO:tasks.ceph.mon.b.smithi106.stderr: 4: (OSDMonitor::prepare_new_pool(std::__cxx11::basic_string, std::allocator >&, int, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned int, unsigned int, unsigned long, unsigned long, float, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned long, OSDMonitor::FastReadType, std::__cxx11::basic_string, std::allocator > const&, std::ostream*)+0x551) [0x55ffaeea3a71] 2021-03-09T08:40:52.761 INFO:tasks.ceph.mon.b.smithi106.stderr: 5: (OSDMonitor::prepare_command_impl(boost::intrusive_ptr, std::map, std::allocator >, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > >, std::less, std::allocator, std::allocator > const, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > > > > > const&)+0x1e4c5) [0x55ffaeed3295] 2021-03-09T08:40:52.761 INFO:tasks.ceph.mon.b.smithi106.stderr: 6: (OSDMonitor::prepare_command(boost::intrusive_ptr)+0x10b) [0x55ffaeedb24b] 2021-03-09T08:40:52.761 INFO:tasks.ceph.mon.b.smithi106.stderr: 7: (OSDMonitor::prepare_update(boost::intrusive_ptr)+0x26b) [0x55ffaeedb7ab] 2021-03-09T08:40:52.762 INFO:tasks.ceph.mon.b.smithi106.stderr: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0x9be) [0x55ffaee4aade] 2021-03-09T08:40:52.762 INFO:tasks.ceph.mon.b.smithi106.stderr: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x55ffaeda0134] 2021-03-09T08:40:52.762 INFO:tasks.ceph.mon.b.smithi106.stderr: 10: (C_MonOp::finish(int)+0x45) [0x55ffaed3eaa5] 2021-03-09T08:40:52.762 INFO:tasks.ceph.mon.b.smithi106.stderr: 11: (Context::complete(int)+0x9) [0x55ffaed3c059] 2021-03-09T08:40:52.763 INFO:tasks.ceph.mon.b.smithi106.stderr: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa8) [0x55ffaed67548] 2021-03-09T08:40:52.763 INFO:tasks.ceph.mon.b.smithi106.stderr: 13: (Paxos::finish_round()+0x9b) [0x55ffaee427db] 2021-03-09T08:40:52.763 INFO:tasks.ceph.mon.b.smithi106.stderr: 14: (Paxos::handle_last(boost::intrusive_ptr)+0xc46) [0x55ffaee43a06] 2021-03-09T08:40:52.763 INFO:tasks.ceph.mon.b.smithi106.stderr: 15: (Paxos::dispatch(boost::intrusive_ptr)+0x3c3) [0x55ffaee44633] 2021-03-09T08:40:52.764 INFO:tasks.ceph.mon.b.smithi106.stderr: 16: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1401) [0x55ffaed39de1] 2021-03-09T08:40:52.764 INFO:tasks.ceph.mon.b.smithi106.stderr: 17: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x55ffaed3a66a] 2021-03-09T08:40:52.764 INFO:tasks.ceph.mon.b.smithi106.stderr: 18: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x55ffaed68178] 2021-03-09T08:40:52.764 INFO:tasks.ceph.mon.b.smithi106.stderr: 19: (DispatchQueue::entry()+0x11ea) [0x7f99cbf552ca] 2021-03-09T08:40:52.765 INFO:tasks.ceph.mon.b.smithi106.stderr: 20: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f99cbfff71d] 2021-03-09T08:40:52.765 INFO:tasks.ceph.mon.b.smithi106.stderr: 21: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f99cabc36db] 2021-03-09T08:40:52.765 INFO:tasks.ceph.mon.b.smithi106.stderr: 22: clone() 2021-03-09T08:40:52.765 INFO:tasks.ceph.mon.b.smithi106.stderr:*** Caught signal (Aborted) ** 2021-03-09T08:40:52.766 INFO:tasks.ceph.mon.b.smithi106.stderr: in thread 7f99bf591700 thread_name:ms_dispatch 2021-03-09T08:40:52.766 INFO:tasks.ceph.mon.b.smithi106.stderr:2021-03-09T08:40:52.761+0000 7f99bf591700 -1 /build/ceph-17.0.0-1742-g89fb622b/src/osd/OSDMapMapping.h: In function 'mempool::osdmap_mapping::vector& OSDMapMapping::get_osd_acting_pgs(unsigned int)' thread 7f99bf591700 time 2021-03-09T08:40:52.747593+0000 2021-03-09T08:40:52.766 INFO:tasks.ceph.mon.b.smithi106.stderr:/build/ceph-17.0.0-1742-g89fb622b/src/osd/OSDMapMapping.h: 325: FAILED ceph_assert(osd < acting_rmap.size()) 2021-03-09T08:40:52.766 INFO:tasks.ceph.mon.b.smithi106.stderr: 2021-03-09T08:40:52.767 INFO:tasks.ceph.mon.b.smithi106.stderr: ceph version 17.0.0-1742-g89fb622b (89fb622b10ca2e58fe0c913a8956377a886e2ab4) quincy (dev) 2021-03-09T08:40:52.767 INFO:tasks.ceph.mon.b.smithi106.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f99cbd533dd] 2021-03-09T08:40:52.767 INFO:tasks.ceph.mon.b.smithi106.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f99cbd535b8] 2021-03-09T08:40:52.767 INFO:tasks.ceph.mon.b.smithi106.stderr: 3: (OSDMonitor::check_pg_num(long, int, int, int, std::ostream*)+0x4f5) [0x55ffaee57a65] 2021-03-09T08:40:52.768 INFO:tasks.ceph.mon.b.smithi106.stderr: 4: (OSDMonitor::prepare_new_pool(std::__cxx11::basic_string, std::allocator >&, int, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned int, unsigned int, unsigned long, unsigned long, float, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned long, OSDMonitor::FastReadType, std::__cxx11::basic_string, std::allocator > const&, std::ostream*)+0x551) [0x55ffaeea3a71] 2021-03-09T08:40:52.768 INFO:tasks.ceph.mon.b.smithi106.stderr: 5: (OSDMonitor::prepare_command_impl(boost::intrusive_ptr, std::map, std::allocator >, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > >, std::less, std::allocator, std::allocator > const, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > > > > > const&)+0x1e4c5) [0x55ffaeed3295] 2021-03-09T08:40:52.768 INFO:tasks.ceph.mon.b.smithi106.stderr: 6: (OSDMonitor::prepare_command(boost::intrusive_ptr)+0x10b) [0x55ffaeedb24b] 2021-03-09T08:40:52.768 INFO:tasks.ceph.mon.b.smithi106.stderr: 7: (OSDMonitor::prepare_update(boost::intrusive_ptr)+0x26b) [0x55ffaeedb7ab] 2021-03-09T08:40:52.769 INFO:tasks.ceph.mon.b.smithi106.stderr: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0x9be) [0x55ffaee4aade] 2021-03-09T08:40:52.769 INFO:tasks.ceph.mon.b.smithi106.stderr: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x55ffaeda0134] 2021-03-09T08:40:52.769 INFO:tasks.ceph.mon.b.smithi106.stderr: 10: (C_MonOp::finish(int)+0x45) [0x55ffaed3eaa5] 2021-03-09T08:40:52.769 INFO:tasks.ceph.mon.b.smithi106.stderr: 11: (Context::complete(int)+0x9) [0x55ffaed3c059] 2021-03-09T08:40:52.770 INFO:tasks.ceph.mon.b.smithi106.stderr: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa8) [0x55ffaed67548] 2021-03-09T08:40:52.770 INFO:tasks.ceph.mon.b.smithi106.stderr: 13: (Paxos::finish_round()+0x9b) [0x55ffaee427db] 2021-03-09T08:40:52.770 INFO:tasks.ceph.mon.b.smithi106.stderr: 14: (Paxos::handle_last(boost::intrusive_ptr)+0xc46) [0x55ffaee43a06] 2021-03-09T08:40:52.770 INFO:tasks.ceph.mon.b.smithi106.stderr: 15: (Paxos::dispatch(boost::intrusive_ptr)+0x3c3) [0x55ffaee44633] 2021-03-09T08:40:52.771 INFO:tasks.ceph.mon.b.smithi106.stderr: 16: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1401) [0x55ffaed39de1] 2021-03-09T08:40:52.771 INFO:tasks.ceph.mon.b.smithi106.stderr: 17: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x55ffaed3a66a] 2021-03-09T08:40:52.771 INFO:tasks.ceph.mon.b.smithi106.stderr: 18: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x55ffaed68178] 2021-03-09T08:40:52.772 INFO:tasks.ceph.mon.b.smithi106.stderr: 19: (DispatchQueue::entry()+0x11ea) [0x7f99cbf552ca] 2021-03-09T08:40:52.772 INFO:tasks.ceph.mon.b.smithi106.stderr: 20: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f99cbfff71d] 2021-03-09T08:40:52.772 INFO:tasks.ceph.mon.b.smithi106.stderr: 21: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f99cabc36db] 2021-03-09T08:40:52.773 INFO:tasks.ceph.mon.b.smithi106.stderr: 22: clone() 2021-03-09T08:40:52.773 INFO:tasks.ceph.mon.b.smithi106.stderr: 2021-03-09T08:40:52.774 INFO:tasks.ceph.mon.b.smithi106.stderr: ceph version 17.0.0-1742-g89fb622b (89fb622b10ca2e58fe0c913a8956377a886e2ab4) quincy (dev) 2021-03-09T08:40:52.774 INFO:tasks.ceph.mon.b.smithi106.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980) [0x7f99cabce980] 2021-03-09T08:40:52.775 INFO:tasks.ceph.mon.b.smithi106.stderr: 2: gsignal() 2021-03-09T08:40:52.775 INFO:tasks.ceph.mon.b.smithi106.stderr: 3: abort() 2021-03-09T08:40:52.775 INFO:tasks.ceph.mon.b.smithi106.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x19c) [0x7f99cbd5342e] 2021-03-09T08:40:52.775 INFO:tasks.ceph.mon.b.smithi106.stderr: 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f99cbd535b8] 2021-03-09T08:40:52.776 INFO:tasks.ceph.mon.b.smithi106.stderr: 6: (OSDMonitor::check_pg_num(long, int, int, int, std::ostream*)+0x4f5) [0x55ffaee57a65] 2021-03-09T08:40:52.776 INFO:tasks.ceph.mon.b.smithi106.stderr: 7: (OSDMonitor::prepare_new_pool(std::__cxx11::basic_string, std::allocator >&, int, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned int, unsigned int, unsigned long, unsigned long, float, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned long, OSDMonitor::FastReadType, std::__cxx11::basic_string, std::allocator > const&, std::ostream*)+0x551) [0x55ffaeea3a71] 2021-03-09T08:40:52.776 INFO:tasks.ceph.mon.b.smithi106.stderr: 8: (OSDMonitor::prepare_command_impl(boost::intrusive_ptr, std::map, std::allocator >, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > >, std::less, std::allocator, std::allocator > const, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > > > > > const&)+0x1e4c5) [0x55ffaeed3295] 2021-03-09T08:40:52.777 INFO:tasks.ceph.mon.b.smithi106.stderr: 9: (OSDMonitor::prepare_command(boost::intrusive_ptr)+0x10b) [0x55ffaeedb24b] 2021-03-09T08:40:52.777 INFO:tasks.ceph.mon.b.smithi106.stderr: 10: (OSDMonitor::prepare_update(boost::intrusive_ptr)+0x26b) [0x55ffaeedb7ab] 2021-03-09T08:40:52.777 INFO:tasks.ceph.mon.b.smithi106.stderr: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0x9be) [0x55ffaee4aade] 2021-03-09T08:40:52.777 INFO:tasks.ceph.mon.b.smithi106.stderr: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x55ffaeda0134] 2021-03-09T08:40:52.778 INFO:tasks.ceph.mon.b.smithi106.stderr: 13: (C_MonOp::finish(int)+0x45) [0x55ffaed3eaa5] 2021-03-09T08:40:52.778 INFO:tasks.ceph.mon.b.smithi106.stderr: 14: (Context::complete(int)+0x9) [0x55ffaed3c059] 2021-03-09T08:40:52.778 INFO:tasks.ceph.mon.b.smithi106.stderr: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa8) [0x55ffaed67548] 2021-03-09T08:40:52.778 INFO:tasks.ceph.mon.b.smithi106.stderr: 16: (Paxos::finish_round()+0x9b) [0x55ffaee427db] 2021-03-09T08:40:52.779 INFO:tasks.ceph.mon.b.smithi106.stderr: 17: (Paxos::handle_last(boost::intrusive_ptr)+0xc46) [0x55ffaee43a06] 2021-03-09T08:40:52.779 INFO:tasks.ceph.mon.b.smithi106.stderr: 18: (Paxos::dispatch(boost::intrusive_ptr)+0x3c3) [0x55ffaee44633] 2021-03-09T08:40:52.779 INFO:tasks.ceph.mon.b.smithi106.stderr: 19: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1401) [0x55ffaed39de1] 2021-03-09T08:40:52.780 INFO:tasks.ceph.mon.b.smithi106.stderr: 20: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x55ffaed3a66a] 2021-03-09T08:40:52.780 INFO:tasks.ceph.mon.b.smithi106.stderr: 21: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x55ffaed68178] 2021-03-09T08:40:52.780 INFO:tasks.ceph.mon.b.smithi106.stderr: 22: (DispatchQueue::entry()+0x11ea) [0x7f99cbf552ca] 2021-03-09T08:40:52.780 INFO:tasks.ceph.mon.b.smithi106.stderr: 23: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f99cbfff71d] 2021-03-09T08:40:52.781 INFO:tasks.ceph.mon.b.smithi106.stderr: 24: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f99cabc36db] 2021-03-09T08:40:52.781 INFO:tasks.ceph.mon.b.smithi106.stderr: 25: clone() 2021-03-09T08:40:52.781 INFO:tasks.ceph.mon.b.smithi106.stderr:2021-03-09T08:40:52.765+0000 7f99bf591700 -1 *** Caught signal (Aborted) ** 2021-03-09T08:40:52.782 INFO:tasks.ceph.mon.b.smithi106.stderr: in thread 7f99bf591700 thread_name:ms_dispatch 2021-03-09T08:40:52.782 INFO:tasks.ceph.mon.b.smithi106.stderr: 2021-03-09T08:40:52.782 INFO:tasks.ceph.mon.b.smithi106.stderr: ceph version 17.0.0-1742-g89fb622b (89fb622b10ca2e58fe0c913a8956377a886e2ab4) quincy (dev) 2021-03-09T08:40:52.782 INFO:tasks.ceph.mon.b.smithi106.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980) [0x7f99cabce980] 2021-03-09T08:40:52.783 INFO:tasks.ceph.mon.b.smithi106.stderr: 2: gsignal() 2021-03-09T08:40:52.783 INFO:tasks.ceph.mon.b.smithi106.stderr: 3: abort() 2021-03-09T08:40:52.783 INFO:tasks.ceph.mon.b.smithi106.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x19c) [0x7f99cbd5342e] 2021-03-09T08:40:52.783 INFO:tasks.ceph.mon.b.smithi106.stderr: 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f99cbd535b8] 2021-03-09T08:40:52.784 INFO:tasks.ceph.mon.b.smithi106.stderr: 6: (OSDMonitor::check_pg_num(long, int, int, int, std::ostream*)+0x4f5) [0x55ffaee57a65] 2021-03-09T08:40:52.784 INFO:tasks.ceph.mon.b.smithi106.stderr: 7: (OSDMonitor::prepare_new_pool(std::__cxx11::basic_string, std::allocator >&, int, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned int, unsigned int, unsigned long, unsigned long, float, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned long, OSDMonitor::FastReadType, std::__cxx11::basic_string, std::allocator > const&, std::ostream*)+0x551) [0x55ffaeea3a71] 2021-03-09T08:40:52.784 INFO:tasks.ceph.mon.b.smithi106.stderr: 8: (OSDMonitor::prepare_command_impl(boost::intrusive_ptr, std::map, std::allocator >, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > >, std::less, std::allocator, std::allocator > const, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > > > > > const&)+0x1e4c5) [0x55ffaeed3295] 2021-03-09T08:40:52.784 INFO:tasks.ceph.mon.b.smithi106.stderr: 9: (OSDMonitor::prepare_command(boost::intrusive_ptr)+0x10b) [0x55ffaeedb24b] 2021-03-09T08:40:52.785 INFO:tasks.ceph.mon.b.smithi106.stderr: 10: (OSDMonitor::prepare_update(boost::intrusive_ptr)+0x26b) [0x55ffaeedb7ab] 2021-03-09T08:40:52.785 INFO:tasks.ceph.mon.b.smithi106.stderr: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0x9be) [0x55ffaee4aade] 2021-03-09T08:40:52.785 INFO:tasks.ceph.mon.b.smithi106.stderr: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x55ffaeda0134] 2021-03-09T08:40:52.785 INFO:tasks.ceph.mon.b.smithi106.stderr: 13: (C_MonOp::finish(int)+0x45) [0x55ffaed3eaa5] 2021-03-09T08:40:52.786 INFO:tasks.ceph.mon.b.smithi106.stderr: 14: (Context::complete(int)+0x9) [0x55ffaed3c059] 2021-03-09T08:40:52.786 INFO:tasks.ceph.mon.b.smithi106.stderr: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa8) [0x55ffaed67548] 2021-03-09T08:40:52.786 INFO:tasks.ceph.mon.b.smithi106.stderr: 16: (Paxos::finish_round()+0x9b) [0x55ffaee427db] 2021-03-09T08:40:52.786 INFO:tasks.ceph.mon.b.smithi106.stderr: 17: (Paxos::handle_last(boost::intrusive_ptr)+0xc46) [0x55ffaee43a06] 2021-03-09T08:40:52.787 INFO:tasks.ceph.mon.b.smithi106.stderr: 18: (Paxos::dispatch(boost::intrusive_ptr)+0x3c3) [0x55ffaee44633] 2021-03-09T08:40:52.787 INFO:tasks.ceph.mon.b.smithi106.stderr: 19: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1401) [0x55ffaed39de1] 2021-03-09T08:40:52.787 INFO:tasks.ceph.mon.b.smithi106.stderr: 20: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x55ffaed3a66a] 2021-03-09T08:40:52.788 INFO:tasks.ceph.mon.b.smithi106.stderr: 21: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x55ffaed68178] 2021-03-09T08:40:52.788 INFO:tasks.ceph.mon.b.smithi106.stderr: 22: (DispatchQueue::entry()+0x11ea) [0x7f99cbf552ca] 2021-03-09T08:40:52.788 INFO:tasks.ceph.mon.b.smithi106.stderr: 23: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f99cbfff71d] 2021-03-09T08:40:52.788 INFO:tasks.ceph.mon.b.smithi106.stderr: 24: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f99cabc36db] 2021-03-09T08:40:52.790 INFO:tasks.ceph.mon.b.smithi106.stderr: 25: clone() 2021-03-09T08:40:52.790 INFO:tasks.ceph.mon.b.smithi106.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-03-09T08:40:52.790 INFO:tasks.ceph.mon.b.smithi106.stderr: 2021-03-09T08:40:52.791 INFO:tasks.ceph.mon.b.smithi106.stderr: -1> 2021-03-09T08:40:52.761+0000 7f99bf591700 -1 /build/ceph-17.0.0-1742-g89fb622b/src/osd/OSDMapMapping.h: In function 'mempool::osdmap_mapping::vector& OSDMapMapping::get_osd_acting_pgs(unsigned int)' thread 7f99bf591700 time 2021-03-09T08:40:52.747593+0000 2021-03-09T08:40:52.792 INFO:tasks.ceph.mon.b.smithi106.stderr:/build/ceph-17.0.0-1742-g89fb622b/src/osd/OSDMapMapping.h: 325: FAILED ceph_assert(osd < acting_rmap.size()) 2021-03-09T08:40:52.793 INFO:tasks.ceph.mon.b.smithi106.stderr: 2021-03-09T08:40:52.793 INFO:tasks.ceph.mon.b.smithi106.stderr: ceph version 17.0.0-1742-g89fb622b (89fb622b10ca2e58fe0c913a8956377a886e2ab4) quincy (dev) 2021-03-09T08:40:52.793 INFO:tasks.ceph.mon.b.smithi106.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f99cbd533dd] 2021-03-09T08:40:52.794 INFO:tasks.ceph.mon.b.smithi106.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f99cbd535b8] 2021-03-09T08:40:52.794 INFO:tasks.ceph.mon.b.smithi106.stderr: 3: (OSDMonitor::check_pg_num(long, int, int, int, std::ostream*)+0x4f5) [0x55ffaee57a65] 2021-03-09T08:40:52.794 INFO:tasks.ceph.mon.b.smithi106.stderr: 4: (OSDMonitor::prepare_new_pool(std::__cxx11::basic_string, std::allocator >&, int, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned int, unsigned int, unsigned long, unsigned long, float, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned long, OSDMonitor::FastReadType, std::__cxx11::basic_string, std::allocator > const&, std::ostream*)+0x551) [0x55ffaeea3a71] 2021-03-09T08:40:52.795 INFO:tasks.ceph.mon.b.smithi106.stderr: 5: (OSDMonitor::prepare_command_impl(boost::intrusive_ptr, std::map, std::allocator >, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > >, std::less, std::allocator, std::allocator > const, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > > > > > const&)+0x1e4c5) [0x55ffaeed3295] 2021-03-09T08:40:52.795 INFO:tasks.ceph.mon.b.smithi106.stderr: 6: (OSDMonitor::prepare_command(boost::intrusive_ptr)+0x10b) [0x55ffaeedb24b] 2021-03-09T08:40:52.795 INFO:tasks.ceph.mon.b.smithi106.stderr: 7: (OSDMonitor::prepare_update(boost::intrusive_ptr)+0x26b) [0x55ffaeedb7ab] 2021-03-09T08:40:52.795 INFO:tasks.ceph.mon.b.smithi106.stderr: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0x9be) [0x55ffaee4aade] 2021-03-09T08:40:52.796 INFO:tasks.ceph.mon.b.smithi106.stderr: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x55ffaeda0134] 2021-03-09T08:40:52.796 INFO:tasks.ceph.mon.b.smithi106.stderr: 10: (C_MonOp::finish(int)+0x45) [0x55ffaed3eaa5] 2021-03-09T08:40:52.796 INFO:tasks.ceph.mon.b.smithi106.stderr: 11: (Context::complete(int)+0x9) [0x55ffaed3c059] 2021-03-09T08:40:52.796 INFO:tasks.ceph.mon.b.smithi106.stderr: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa8) [0x55ffaed67548] 2021-03-09T08:40:52.797 INFO:tasks.ceph.mon.b.smithi106.stderr: 13: (Paxos::finish_round()+0x9b) [0x55ffaee427db] 2021-03-09T08:40:52.797 INFO:tasks.ceph.mon.b.smithi106.stderr: 14: (Paxos::handle_last(boost::intrusive_ptr)+0xc46) [0x55ffaee43a06] 2021-03-09T08:40:52.797 INFO:tasks.ceph.mon.b.smithi106.stderr: 15: (Paxos::dispatch(boost::intrusive_ptr)+0x3c3) [0x55ffaee44633] 2021-03-09T08:40:52.797 INFO:tasks.ceph.mon.b.smithi106.stderr: 16: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1401) [0x55ffaed39de1] 2021-03-09T08:40:52.798 INFO:tasks.ceph.mon.b.smithi106.stderr: 17: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x55ffaed3a66a] 2021-03-09T08:40:52.798 INFO:tasks.ceph.mon.b.smithi106.stderr: 18: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x55ffaed68178] 2021-03-09T08:40:52.798 INFO:tasks.ceph.mon.b.smithi106.stderr: 19: (DispatchQueue::entry()+0x11ea) [0x7f99cbf552ca] 2021-03-09T08:40:52.798 INFO:tasks.ceph.mon.b.smithi106.stderr: 20: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f99cbfff71d] 2021-03-09T08:40:52.799 INFO:tasks.ceph.mon.b.smithi106.stderr: 21: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f99cabc36db] 2021-03-09T08:40:52.799 INFO:tasks.ceph.mon.b.smithi106.stderr: 22: clone() 2021-03-09T08:40:52.799 INFO:tasks.ceph.mon.b.smithi106.stderr: 2021-03-09T08:40:52.799 INFO:tasks.ceph.mon.b.smithi106.stderr: 0> 2021-03-09T08:40:52.765+0000 7f99bf591700 -1 *** Caught signal (Aborted) ** 2021-03-09T08:40:52.800 INFO:tasks.ceph.mon.b.smithi106.stderr: in thread 7f99bf591700 thread_name:ms_dispatch 2021-03-09T08:40:52.800 INFO:tasks.ceph.mon.b.smithi106.stderr: 2021-03-09T08:40:52.800 INFO:tasks.ceph.mon.b.smithi106.stderr: ceph version 17.0.0-1742-g89fb622b (89fb622b10ca2e58fe0c913a8956377a886e2ab4) quincy (dev) 2021-03-09T08:40:52.801 INFO:tasks.ceph.mon.b.smithi106.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980) [0x7f99cabce980] 2021-03-09T08:40:52.801 INFO:tasks.ceph.mon.b.smithi106.stderr: 2: gsignal() 2021-03-09T08:40:52.801 INFO:tasks.ceph.mon.b.smithi106.stderr: 3: abort() 2021-03-09T08:40:52.802 INFO:tasks.ceph.mon.b.smithi106.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x19c) [0x7f99cbd5342e] 2021-03-09T08:40:52.802 INFO:tasks.ceph.mon.b.smithi106.stderr: 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f99cbd535b8] 2021-03-09T08:40:52.802 INFO:tasks.ceph.mon.b.smithi106.stderr: 6: (OSDMonitor::check_pg_num(long, int, int, int, std::ostream*)+0x4f5) [0x55ffaee57a65] 2021-03-09T08:40:52.802 INFO:tasks.ceph.mon.b.smithi106.stderr: 7: (OSDMonitor::prepare_new_pool(std::__cxx11::basic_string, std::allocator >&, int, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned int, unsigned int, unsigned long, unsigned long, float, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned long, OSDMonitor::FastReadType, std::__cxx11::basic_string, std::allocator > const&, std::ostream*)+0x551) [0x55ffaeea3a71] 2021-03-09T08:40:52.803 INFO:tasks.ceph.mon.b.smithi106.stderr: 8: (OSDMonitor::prepare_command_impl(boost::intrusive_ptr, std::map, std::allocator >, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > >, std::less, std::allocator, std::allocator > const, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > > > > > const&)+0x1e4c5) [0x55ffaeed3295] 2021-03-09T08:40:52.803 INFO:tasks.ceph.mon.b.smithi106.stderr: 9: (OSDMonitor::prepare_command(boost::intrusive_ptr)+0x10b) [0x55ffaeedb24b] 2021-03-09T08:40:52.803 INFO:tasks.ceph.mon.b.smithi106.stderr: 10: (OSDMonitor::prepare_update(boost::intrusive_ptr)+0x26b) [0x55ffaeedb7ab] 2021-03-09T08:40:52.804 INFO:tasks.ceph.mon.b.smithi106.stderr: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0x9be) [0x55ffaee4aade] 2021-03-09T08:40:52.804 INFO:tasks.ceph.mon.b.smithi106.stderr: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x55ffaeda0134] 2021-03-09T08:40:52.804 INFO:tasks.ceph.mon.b.smithi106.stderr: 13: (C_MonOp::finish(int)+0x45) [0x55ffaed3eaa5] 2021-03-09T08:40:52.804 INFO:tasks.ceph.mon.b.smithi106.stderr: 14: (Context::complete(int)+0x9) [0x55ffaed3c059] 2021-03-09T08:40:52.805 INFO:tasks.ceph.mon.b.smithi106.stderr: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa8) [0x55ffaed67548] 2021-03-09T08:40:52.805 INFO:tasks.ceph.mon.b.smithi106.stderr: 16: (Paxos::finish_round()+0x9b) [0x55ffaee427db] 2021-03-09T08:40:52.805 INFO:tasks.ceph.mon.b.smithi106.stderr: 17: (Paxos::handle_last(boost::intrusive_ptr)+0xc46) [0x55ffaee43a06] 2021-03-09T08:40:52.805 INFO:tasks.ceph.mon.b.smithi106.stderr: 18: (Paxos::dispatch(boost::intrusive_ptr)+0x3c3) [0x55ffaee44633] 2021-03-09T08:40:52.805 INFO:tasks.ceph.mon.b.smithi106.stderr: 19: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1401) [0x55ffaed39de1] 2021-03-09T08:40:52.806 INFO:tasks.ceph.mon.b.smithi106.stderr: 20: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x55ffaed3a66a] 2021-03-09T08:40:52.806 INFO:tasks.ceph.mon.b.smithi106.stderr: 21: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x55ffaed68178] 2021-03-09T08:40:52.806 INFO:tasks.ceph.mon.b.smithi106.stderr: 22: (DispatchQueue::entry()+0x11ea) [0x7f99cbf552ca] 2021-03-09T08:40:52.806 INFO:tasks.ceph.mon.b.smithi106.stderr: 23: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f99cbfff71d] 2021-03-09T08:40:52.807 INFO:tasks.ceph.mon.b.smithi106.stderr: 24: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f99cabc36db] 2021-03-09T08:40:52.807 INFO:tasks.ceph.mon.b.smithi106.stderr: 25: clone() 2021-03-09T08:40:52.807 INFO:tasks.ceph.mon.b.smithi106.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-03-09T08:40:52.807 INFO:tasks.ceph.mon.b.smithi106.stderr: 2021-03-09T08:40:52.808 INFO:tasks.ceph.mon.b.smithi106.stderr: -1> 2021-03-09T08:40:52.761+0000 7f99bf591700 -1 /build/ceph-17.0.0-1742-g89fb622b/src/osd/OSDMapMapping.h: In function 'mempool::osdmap_mapping::vector& OSDMapMapping::get_osd_acting_pgs(unsigned int)' thread 7f99bf591700 time 2021-03-09T08:40:52.747593+0000 2021-03-09T08:40:52.808 INFO:tasks.ceph.mon.b.smithi106.stderr:/build/ceph-17.0.0-1742-g89fb622b/src/osd/OSDMapMapping.h: 325: FAILED ceph_assert(osd < acting_rmap.size()) 2021-03-09T08:40:52.809 INFO:tasks.ceph.mon.b.smithi106.stderr: 2021-03-09T08:40:52.809 INFO:tasks.ceph.mon.b.smithi106.stderr: ceph version 17.0.0-1742-g89fb622b (89fb622b10ca2e58fe0c913a8956377a886e2ab4) quincy (dev) 2021-03-09T08:40:52.809 INFO:tasks.ceph.mon.b.smithi106.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f99cbd533dd] 2021-03-09T08:40:52.809 INFO:tasks.ceph.mon.b.smithi106.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f99cbd535b8] 2021-03-09T08:40:52.810 INFO:tasks.ceph.mon.b.smithi106.stderr: 3: (OSDMonitor::check_pg_num(long, int, int, int, std::ostream*)+0x4f5) [0x55ffaee57a65] 2021-03-09T08:40:52.810 INFO:tasks.ceph.mon.b.smithi106.stderr: 4: (OSDMonitor::prepare_new_pool(std::__cxx11::basic_string, std::allocator >&, int, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned int, unsigned int, unsigned long, unsigned long, float, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned long, OSDMonitor::FastReadType, std::__cxx11::basic_string, std::allocator > const&, std::ostream*)+0x551) [0x55ffaeea3a71] 2021-03-09T08:40:52.810 INFO:tasks.ceph.mon.b.smithi106.stderr: 5: (OSDMonitor::prepare_command_impl(boost::intrusive_ptr, std::map, std::allocator >, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > >, std::less, std::allocator, std::allocator > const, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > > > > > const&)+0x1e4c5) [0x55ffaeed3295] 2021-03-09T08:40:52.810 INFO:tasks.ceph.mon.b.smithi106.stderr: 6: (OSDMonitor::prepare_command(boost::intrusive_ptr)+0x10b) [0x55ffaeedb24b] 2021-03-09T08:40:52.811 INFO:tasks.ceph.mon.b.smithi106.stderr: 7: (OSDMonitor::prepare_update(boost::intrusive_ptr)+0x26b) [0x55ffaeedb7ab] 2021-03-09T08:40:52.811 INFO:tasks.ceph.mon.b.smithi106.stderr: 8: (PaxosService::dispatch(boost::intrusive_ptr)+0x9be) [0x55ffaee4aade] 2021-03-09T08:40:52.811 INFO:tasks.ceph.mon.b.smithi106.stderr: 9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x55ffaeda0134] 2021-03-09T08:40:52.812 INFO:tasks.ceph.mon.b.smithi106.stderr: 10: (C_MonOp::finish(int)+0x45) [0x55ffaed3eaa5] 2021-03-09T08:40:52.812 INFO:tasks.ceph.mon.b.smithi106.stderr: 11: (Context::complete(int)+0x9) [0x55ffaed3c059] 2021-03-09T08:40:52.812 INFO:tasks.ceph.mon.b.smithi106.stderr: 12: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa8) [0x55ffaed67548] 2021-03-09T08:40:52.812 INFO:tasks.ceph.mon.b.smithi106.stderr: 13: (Paxos::finish_round()+0x9b) [0x55ffaee427db] 2021-03-09T08:40:52.812 INFO:tasks.ceph.mon.b.smithi106.stderr: 14: (Paxos::handle_last(boost::intrusive_ptr)+0xc46) [0x55ffaee43a06] 2021-03-09T08:40:52.813 INFO:tasks.ceph.mon.b.smithi106.stderr: 15: (Paxos::dispatch(boost::intrusive_ptr)+0x3c3) [0x55ffaee44633] 2021-03-09T08:40:52.813 INFO:tasks.ceph.mon.b.smithi106.stderr: 16: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1401) [0x55ffaed39de1] 2021-03-09T08:40:52.813 INFO:tasks.ceph.mon.b.smithi106.stderr: 17: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x55ffaed3a66a] 2021-03-09T08:40:52.813 INFO:tasks.ceph.mon.b.smithi106.stderr: 18: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x55ffaed68178] 2021-03-09T08:40:52.814 INFO:tasks.ceph.mon.b.smithi106.stderr: 19: (DispatchQueue::entry()+0x11ea) [0x7f99cbf552ca] 2021-03-09T08:40:52.814 INFO:tasks.ceph.mon.b.smithi106.stderr: 20: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f99cbfff71d] 2021-03-09T08:40:52.814 INFO:tasks.ceph.mon.b.smithi106.stderr: 21: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f99cabc36db] 2021-03-09T08:40:52.814 INFO:tasks.ceph.mon.b.smithi106.stderr: 22: clone() 2021-03-09T08:40:52.815 INFO:tasks.ceph.mon.b.smithi106.stderr: 2021-03-09T08:40:52.815 INFO:tasks.ceph.mon.b.smithi106.stderr: 0> 2021-03-09T08:40:52.765+0000 7f99bf591700 -1 *** Caught signal (Aborted) ** 2021-03-09T08:40:52.815 INFO:tasks.ceph.mon.b.smithi106.stderr: in thread 7f99bf591700 thread_name:ms_dispatch 2021-03-09T08:40:52.815 INFO:tasks.ceph.mon.b.smithi106.stderr: 2021-03-09T08:40:52.816 INFO:tasks.ceph.mon.b.smithi106.stderr: ceph version 17.0.0-1742-g89fb622b (89fb622b10ca2e58fe0c913a8956377a886e2ab4) quincy (dev) 2021-03-09T08:40:52.816 INFO:tasks.ceph.mon.b.smithi106.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980) [0x7f99cabce980] 2021-03-09T08:40:52.816 INFO:tasks.ceph.mon.b.smithi106.stderr: 2: gsignal() 2021-03-09T08:40:52.816 INFO:tasks.ceph.mon.b.smithi106.stderr: 3: abort() 2021-03-09T08:40:52.817 INFO:tasks.ceph.mon.b.smithi106.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x19c) [0x7f99cbd5342e] 2021-03-09T08:40:52.817 INFO:tasks.ceph.mon.b.smithi106.stderr: 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f99cbd535b8] 2021-03-09T08:40:52.817 INFO:tasks.ceph.mon.b.smithi106.stderr: 6: (OSDMonitor::check_pg_num(long, int, int, int, std::ostream*)+0x4f5) [0x55ffaee57a65] 2021-03-09T08:40:52.817 INFO:tasks.ceph.mon.b.smithi106.stderr: 7: (OSDMonitor::prepare_new_pool(std::__cxx11::basic_string, std::allocator >&, int, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned int, unsigned int, unsigned long, unsigned long, float, std::__cxx11::basic_string, std::allocator > const&, unsigned int, unsigned long, OSDMonitor::FastReadType, std::__cxx11::basic_string, std::allocator > const&, std::ostream*)+0x551) [0x55ffaeea3a71] 2021-03-09T08:40:52.818 INFO:tasks.ceph.mon.b.smithi106.stderr: 8: (OSDMonitor::prepare_command_impl(boost::intrusive_ptr, std::map, std::allocator >, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > >, std::less, std::allocator, std::allocator > const, boost::variant, std::allocator >, bool, long, double, std::vector, std::allocator >, std::allocator, std::allocator > > >, std::vector >, std::vector > > > > > const&)+0x1e4c5) [0x55ffaeed3295] 2021-03-09T08:40:52.818 INFO:tasks.ceph.mon.b.smithi106.stderr: 9: (OSDMonitor::prepare_command(boost::intrusive_ptr)+0x10b) [0x55ffaeedb24b] 2021-03-09T08:40:52.818 INFO:tasks.ceph.mon.b.smithi106.stderr: 10: (OSDMonitor::prepare_update(boost::intrusive_ptr)+0x26b) [0x55ffaeedb7ab] 2021-03-09T08:40:52.818 INFO:tasks.ceph.mon.b.smithi106.stderr: 11: (PaxosService::dispatch(boost::intrusive_ptr)+0x9be) [0x55ffaee4aade] 2021-03-09T08:40:52.819 INFO:tasks.ceph.mon.b.smithi106.stderr: 12: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x55ffaeda0134] 2021-03-09T08:40:52.819 INFO:tasks.ceph.mon.b.smithi106.stderr: 13: (C_MonOp::finish(int)+0x45) [0x55ffaed3eaa5] 2021-03-09T08:40:52.819 INFO:tasks.ceph.mon.b.smithi106.stderr: 14: (Context::complete(int)+0x9) [0x55ffaed3c059] 2021-03-09T08:40:52.819 INFO:tasks.ceph.mon.b.smithi106.stderr: 15: (void finish_contexts > >(ceph::common::CephContext*, std::__cxx11::list >&, int)+0xa8) [0x55ffaed67548] 2021-03-09T08:40:52.820 INFO:tasks.ceph.mon.b.smithi106.stderr: 16: (Paxos::finish_round()+0x9b) [0x55ffaee427db] 2021-03-09T08:40:52.820 INFO:tasks.ceph.mon.b.smithi106.stderr: 17: (Paxos::handle_last(boost::intrusive_ptr)+0xc46) [0x55ffaee43a06] 2021-03-09T08:40:52.820 INFO:tasks.ceph.mon.b.smithi106.stderr: 18: (Paxos::dispatch(boost::intrusive_ptr)+0x3c3) [0x55ffaee44633] 2021-03-09T08:40:52.820 INFO:tasks.ceph.mon.b.smithi106.stderr: 19: (Monitor::dispatch_op(boost::intrusive_ptr)+0x1401) [0x55ffaed39de1] 2021-03-09T08:40:52.821 INFO:tasks.ceph.mon.b.smithi106.stderr: 20: (Monitor::_ms_dispatch(Message*)+0x4ea) [0x55ffaed3a66a] 2021-03-09T08:40:52.821 INFO:tasks.ceph.mon.b.smithi106.stderr: 21: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x55ffaed68178] 2021-03-09T08:40:52.821 INFO:tasks.ceph.mon.b.smithi106.stderr: 22: (DispatchQueue::entry()+0x11ea) [0x7f99cbf552ca] 2021-03-09T08:40:52.821 INFO:tasks.ceph.mon.b.smithi106.stderr: 23: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f99cbfff71d] 2021-03-09T08:40:52.822 INFO:tasks.ceph.mon.b.smithi106.stderr: 24: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f99cabc36db] 2021-03-09T08:40:52.822 INFO:tasks.ceph.mon.b.smithi106.stderr: 25: clone() 2021-03-09T08:40:52.822 INFO:tasks.ceph.mon.b.smithi106.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-03-09T08:40:52.822 INFO:tasks.ceph.mon.b.smithi106.stderr: 2021-03-09T08:40:53.516 INFO:tasks.ceph.mon.b.smithi106.stderr:daemon-helper: command crashed with signal 6 2021-03-09T08:41:12.320 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:41:12.318+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12 slow ops, oldest is log(2 entries from seq 1 at 2021-03-09T08:40:35.856704+0000) 2021-03-09T08:41:17.324 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:17.319+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd44064d50 legacy=0x7fdd44144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T08:41:17.324 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:17.319+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd44064d50 legacy=0x7fdd44144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:41:17.324 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:17.319+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd44064d50 0x7fdd44144050 :-1 s=OPENED pgs=69 cs=1 l=1).handle_message read tag failed 2021-03-09T08:41:17.325 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:17.319+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd44064d50 0x7fdd44144050 :-1 s=OPENED pgs=69 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:41:17.325 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:17.319+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd44064d50 legacy=0x7fdd44144050 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:41:17.325 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:41:17.319+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:41:17.326 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:17.319+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd44061f00 legacy=0x7fdd24061ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:17.326 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:17.319+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd441438e0 con 0x7fdd44061f00 2021-03-09T08:41:17.326 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:17.319+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd44143bb0 con 0x7fdd44133680 2021-03-09T08:41:17.327 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:17.319+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd24065350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:17.327 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:17.319+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd44144760 con 0x7fdd24066b20 2021-03-09T08:41:17.524 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:17.523+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd44061f00 legacy=0x7fdd24061ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:17.525 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:17.523+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd24065350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:17.928 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:17.927+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd44061f00 legacy=0x7fdd24061ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:17.929 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:17.927+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd24065350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:18.094 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:18.091+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd24066b20 legacy=0x7fdd24068fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-09T08:41:18.095 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:18.091+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd24065350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:41:18.095 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:18.091+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd44061f00 legacy=0x7fdd24061ba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:41:18.096 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:18.091+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2406d870 con 0x7fdd44061f00 2021-03-09T08:41:18.096 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:18.091+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd441438e0 con 0x7fdd44133680 2021-03-09T08:41:18.097 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:18.091+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd44143bb0 con 0x7fdd20006b10 2021-03-09T08:41:18.097 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:18.091+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd44061f00 legacy=0x7fdd2000c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:18.097 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:18.091+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:18.297 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:18.295+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd44061f00 legacy=0x7fdd2000c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:18.297 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:18.295+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:18.701 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:18.698+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd44061f00 legacy=0x7fdd2000c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:18.701 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:18.698+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:19.505 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:19.502+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd44061f00 legacy=0x7fdd2000c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:19.506 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:19.502+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:21.108 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:21.105+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd44061f00 legacy=0x7fdd2000c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:21.108 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:21.105+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:22.325 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:22.317+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T08:41:22.326 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:22.317+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:41:22.326 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:22.317+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd20008fa0 :-1 s=OPENED pgs=117 cs=1 l=1).handle_message read tag failed 2021-03-09T08:41:22.326 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:22.317+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd20008fa0 :-1 s=OPENED pgs=117 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:41:22.327 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:41:22.317+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:41:24.314 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:24.309+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd44061f00 legacy=0x7fdd2000c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:24.315 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:24.309+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:24.845 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:24.841+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:41:24.846 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:24.841+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:41:24.846 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:24.841+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd44061f00 legacy=0x7fdd2000c880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:41:24.846 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:24.841+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20011080 con 0x7fdd20010000 2021-03-09T08:41:24.847 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:24.841+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2406d870 con 0x7fdd44133680 2021-03-09T08:41:24.847 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:24.841+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd441438e0 con 0x7fdd20006b10 2021-03-09T08:41:24.848 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:24.841+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:24.848 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:24.841+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd2000c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:25.050 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:25.045+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:25.050 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:25.045+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd2000c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:25.454 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:25.449+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:25.454 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:25.449+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd2000c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:26.258 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:26.253+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:26.259 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:26.253+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd2000c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:27.326 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:27.321+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T08:41:27.326 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:27.321+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:41:27.327 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:27.321+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd20008fa0 :-1 s=OPENED pgs=126 cs=1 l=1).handle_message read tag failed 2021-03-09T08:41:27.327 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:27.321+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd20008fa0 :-1 s=OPENED pgs=126 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:41:27.327 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:41:27.321+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:41:27.862 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:27.857+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:27.862 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:27.857+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd2000c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:31.065 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:31.061+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:31.066 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:31.061+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd2000c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:32.326 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:41:32.321+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:41:34.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:34.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:41:34.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:34.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd44133680 legacy=0x7fdd2000c880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:41:34.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:34.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:41:34.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:34.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20010cc0 con 0x7fdd20010000 2021-03-09T08:41:34.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:34.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20011080 con 0x7fdd2000cfb0 2021-03-09T08:41:34.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:34.965+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:34.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:34.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2406d870 con 0x7fdd20006b10 2021-03-09T08:41:34.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:34.965+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:35.174 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:35.169+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:35.174 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:35.169+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:35.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:35.573+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:35.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:35.573+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:36.382 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:36.377+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:36.382 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:36.377+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:37.327 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:41:37.321+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:41:37.328 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:37.321+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T08:41:37.328 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:37.321+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:41:37.328 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:37.321+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd20008fa0 :-1 s=OPENED pgs=141 cs=1 l=1).handle_message read tag failed 2021-03-09T08:41:37.328 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:37.321+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd20008fa0 :-1 s=OPENED pgs=141 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:41:37.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:37.981+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:37.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:37.981+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:41.188 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:41.185+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:41.189 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:41.185+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:42.326 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:41:42.321+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:41:47.326 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:41:47.321+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:41:47.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:47.589+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:47.596 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:47.589+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:50.158 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:50.149+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:41:50.158 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:50.149+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:41:50.158 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:50.153+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:41:50.159 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:50.153+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c8d0 con 0x7fdd20010000 2021-03-09T08:41:50.159 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:50.153+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20010cc0 con 0x7fdd2000cfb0 2021-03-09T08:41:50.159 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:50.153+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20011080 con 0x7fdd20006b10 2021-03-09T08:41:50.159 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:50.153+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:50.160 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:50.153+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:50.361 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:50.357+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:50.362 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:50.357+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:50.765 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:50.761+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:50.766 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:50.761+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:51.569 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:51.565+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:51.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:51.565+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:52.327 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:52.321+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T08:41:52.327 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:52.321+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:41:52.327 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:41:52.321+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:41:52.328 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:52.321+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd20008fa0 :-1 s=OPENED pgs=156 cs=1 l=1).handle_message read tag failed 2021-03-09T08:41:52.328 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:52.321+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd20008fa0 :-1 s=OPENED pgs=156 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:41:53.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:53.169+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:53.179 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:53.169+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:56.377 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:56.373+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:41:56.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:41:56.373+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:41:57.327 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:41:57.325+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:42:02.327 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:42:02.321+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:42:02.783 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:02.781+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:42:02.783 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:02.781+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:42:07.327 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:42:07.321+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:42:12.327 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:42:12.321+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:42:12.940 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:12.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:42:12.940 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:12.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:42:12.941 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:12.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:42:12.941 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:12.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000cb30 con 0x7fdd20010000 2021-03-09T08:42:12.942 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:12.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c8d0 con 0x7fdd2000cfb0 2021-03-09T08:42:12.942 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:12.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20010cc0 con 0x7fdd20006b10 2021-03-09T08:42:12.942 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:12.933+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:42:12.943 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:12.933+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:42:13.139 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:13.137+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:42:13.140 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:13.137+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:42:13.545 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:13.541+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:42:13.546 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:13.541+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:42:14.349 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:14.345+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:42:14.349 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:14.345+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:42:15.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:15.949+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:42:15.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:15.949+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:42:17.327 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:42:17.321+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:42:17.327 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:17.321+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T08:42:17.328 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:17.321+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:42:17.328 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:17.321+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd20008fa0 :-1 s=OPENED pgs=165 cs=1 l=1).handle_message read tag failed 2021-03-09T08:42:17.328 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:17.321+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd20008fa0 :-1 s=OPENED pgs=165 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:42:19.154 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:19.153+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:42:19.155 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:19.153+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:42:22.327 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:42:22.321+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:42:25.560 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:25.557+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:42:25.561 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:25.557+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:42:27.327 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:42:27.321+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:42:32.327 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:42:32.321+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:42:37.328 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:42:37.325+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:42:38.373 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:38.369+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:42:38.374 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:38.369+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:42:42.327 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:42:42.325+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:42:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:42:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:42:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:42:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000cd70 con 0x7fdd20010000 2021-03-09T08:42:42.940 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000cb30 con 0x7fdd2000cfb0 2021-03-09T08:42:42.940 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:42.937+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:42:42.940 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:42.937+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:42:42.940 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c8d0 con 0x7fdd20006b10 2021-03-09T08:42:43.144 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:43.141+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:42:43.144 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:43.141+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:42:43.548 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:43.545+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:42:43.548 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:43.545+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:42:44.352 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:44.349+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:42:44.352 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:44.349+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:42:45.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:45.953+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:42:45.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:45.953+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:42:47.327 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:42:47.321+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:42:47.328 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:47.325+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T08:42:47.328 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:47.325+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:42:47.329 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:47.325+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd20008fa0 :-1 s=OPENED pgs=182 cs=1 l=1).handle_message read tag failed 2021-03-09T08:42:47.329 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:47.325+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd20008fa0 :-1 s=OPENED pgs=182 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:42:49.157 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:49.157+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:42:49.158 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:49.157+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:42:52.328 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:42:52.325+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:42:55.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:55.561+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:42:55.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:42:55.561+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:42:57.328 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:42:57.325+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:43:02.328 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:43:02.325+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:43:07.328 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:43:07.325+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:43:08.376 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:08.373+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:43:08.377 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:08.373+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:43:12.328 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:43:12.325+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:43:12.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:12.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008fa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:43:12.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:12.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:43:12.940 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:12.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:43:12.940 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:12.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20010c90 con 0x7fdd20010000 2021-03-09T08:43:12.941 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:12.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000cd70 con 0x7fdd2000cfb0 2021-03-09T08:43:12.941 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:12.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000cb30 con 0x7fdd20006b10 2021-03-09T08:43:12.942 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:12.933+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:43:12.942 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:12.933+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:43:13.139 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:13.137+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:43:13.139 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:13.137+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:43:13.543 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:13.541+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:43:13.543 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:13.541+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:43:14.347 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:14.345+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:43:14.347 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:14.345+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:43:15.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:15.949+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:43:15.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:15.949+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:43:17.328 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:43:17.325+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:43:17.329 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:17.325+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T08:43:17.329 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:17.325+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:43:17.329 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:17.325+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd20008f80 :-1 s=OPENED pgs=199 cs=1 l=1).handle_message read tag failed 2021-03-09T08:43:17.330 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:17.325+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd20008f80 :-1 s=OPENED pgs=199 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:43:19.154 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:19.153+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:43:19.155 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:19.153+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:43:22.328 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:43:22.325+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:43:25.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:25.557+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:43:25.561 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:25.557+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:43:27.328 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:43:27.329+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:43:32.328 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:43:32.329+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:43:37.328 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:43:37.329+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:43:38.368 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:38.365+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:43:38.371 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:38.369+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:43:42.328 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:43:42.325+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:43:42.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:42.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd20008f80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:43:42.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:42.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:43:42.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:42.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20010000 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:43:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:42.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c8d0 con 0x7fdd2000e3a0 2021-03-09T08:43:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:42.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20010c90 con 0x7fdd2000cfb0 2021-03-09T08:43:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:42.933+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000cd70 con 0x7fdd20006b10 2021-03-09T08:43:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:42.933+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000e3a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:43:42.940 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:42.933+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:43:43.138 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:43.137+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000e3a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:43:43.139 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:43.137+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:43:43.542 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:43.541+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000e3a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:43:43.543 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:43.541+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:43:44.346 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:44.345+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000e3a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:43:44.347 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:44.345+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:43:45.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:45.949+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000e3a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:43:45.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:45.949+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:43:47.329 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:43:47.325+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:43:47.330 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:47.325+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T08:43:47.331 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:47.325+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:43:47.331 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:47.325+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=216 cs=1 l=1).handle_message read tag failed 2021-03-09T08:43:47.331 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:47.325+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=216 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:43:49.151 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:49.153+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000e3a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:43:49.152 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:49.153+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:43:52.329 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:43:52.329+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:43:55.558 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:55.557+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000e3a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:43:55.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:43:55.557+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:43:57.329 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:43:57.325+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:44:02.329 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:44:02.329+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:44:07.329 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:44:07.329+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:44:08.371 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:08.369+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000e3a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:44:08.371 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:08.369+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:44:12.329 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:44:12.325+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:44:12.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:12.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:44:12.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:12.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:44:12.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:12.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000e3a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:44:12.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:12.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20008f90 con 0x7fdd20009180 2021-03-09T08:44:12.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:12.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c8d0 con 0x7fdd2000cfb0 2021-03-09T08:44:12.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:12.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20010c90 con 0x7fdd20006b10 2021-03-09T08:44:12.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:12.937+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:44:12.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:12.937+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:44:13.141 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:13.141+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:44:13.142 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:13.141+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:44:13.545 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:13.545+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:44:13.546 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:13.545+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:44:14.349 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:14.349+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:44:14.350 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:14.349+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:44:15.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:15.953+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:44:15.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:15.953+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:44:17.329 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:17.325+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T08:44:17.330 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:17.325+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:44:17.330 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:17.325+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=233 cs=1 l=1).handle_message read tag failed 2021-03-09T08:44:17.330 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:17.325+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=233 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:44:17.331 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:44:17.329+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:44:19.157 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:19.157+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:44:19.158 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:19.157+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:44:22.330 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:44:22.329+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:44:25.561 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:25.561+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:44:25.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:25.561+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:44:27.330 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:44:27.329+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:44:32.330 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:44:32.329+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:44:37.330 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:44:37.329+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:44:38.374 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:38.377+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:44:38.376 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:38.377+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:44:42.330 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:44:42.329+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:44:42.937 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:44:42.937 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:44:42.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:44:42.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000cd50 con 0x7fdd20009180 2021-03-09T08:44:42.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:42.937+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:44:42.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20008f90 con 0x7fdd2000cfb0 2021-03-09T08:44:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c8d0 con 0x7fdd20006b10 2021-03-09T08:44:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:42.937+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:44:43.141 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:43.141+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:44:43.141 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:43.141+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:44:43.545 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:43.545+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:44:43.545 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:43.545+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:44:44.349 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:44.349+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:44:44.349 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:44.349+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:44:45.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:45.953+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:44:45.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:45.953+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:44:47.330 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:44:47.333+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:44:47.331 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:47.333+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T08:44:47.331 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:47.333+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:44:47.331 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:47.333+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=250 cs=1 l=1).handle_message read tag failed 2021-03-09T08:44:47.332 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:47.333+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=250 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:44:49.157 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:49.157+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:44:49.157 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:49.157+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:44:52.330 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:44:52.329+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:44:55.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:55.561+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:44:55.564 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:44:55.561+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:44:57.330 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:44:57.333+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:45:02.331 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:45:02.333+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:45:07.330 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:45:07.329+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:45:08.376 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:08.377+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:45:08.376 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:08.377+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:45:12.330 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:45:12.333+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:45:12.937 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:12.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:45:12.937 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:12.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:45:12.937 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:12.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009180 legacy=0x7fdd20009750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:45:12.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:12.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20010c50 con 0x7fdd200063e0 2021-03-09T08:45:12.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:12.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000cd50 con 0x7fdd2000cfb0 2021-03-09T08:45:12.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:12.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20008f90 con 0x7fdd20006b10 2021-03-09T08:45:12.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:12.937+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200063e0 legacy=0x7fdd20009e60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:45:12.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:12.937+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:45:13.140 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:13.141+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200063e0 legacy=0x7fdd20009e60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:45:13.140 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:13.141+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:45:13.544 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:13.545+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200063e0 legacy=0x7fdd20009e60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:45:13.544 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:13.545+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:45:14.348 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:14.349+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200063e0 legacy=0x7fdd20009e60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:45:14.348 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:14.349+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:45:15.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:15.953+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200063e0 legacy=0x7fdd20009e60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:45:15.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:15.953+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:45:17.330 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:45:17.333+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:45:17.331 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:17.333+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T08:45:17.332 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:17.333+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:45:17.332 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:17.333+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=267 cs=1 l=1).handle_message read tag failed 2021-03-09T08:45:17.332 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:17.333+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=267 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:45:19.156 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:19.157+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200063e0 legacy=0x7fdd20009e60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:45:19.156 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:19.157+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:45:22.331 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:45:22.333+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:45:25.560 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:25.561+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:45:25.560 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:25.561+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200063e0 legacy=0x7fdd20009e60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:45:27.331 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:45:27.333+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:45:32.331 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:45:32.333+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:45:37.331 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:45:37.329+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:45:38.363 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:38.365+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:45:38.367 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:38.369+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200063e0 legacy=0x7fdd20009e60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:45:42.331 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:45:42.333+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:45:42.936 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:45:42.937 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:45:42.937 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200063e0 legacy=0x7fdd20009e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:45:42.937 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c8d0 con 0x7fdd20009750 2021-03-09T08:45:42.937 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20010c50 con 0x7fdd2000cfb0 2021-03-09T08:45:42.937 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:42.937+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000cd50 con 0x7fdd20006b10 2021-03-09T08:45:42.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:42.937+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:45:42.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:42.937+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:45:43.139 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:43.141+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:45:43.139 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:43.141+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:45:43.543 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:43.545+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:45:43.543 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:43.545+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:45:44.347 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:44.349+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:45:44.348 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:44.349+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:45:45.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:45.953+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:45:45.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:45.953+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:45:47.331 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:45:47.333+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:45:47.433 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:47.333+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T08:45:47.434 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:47.333+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:45:47.434 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:47.333+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=284 cs=1 l=1).handle_message read tag failed 2021-03-09T08:45:47.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:47.333+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=284 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:45:49.152 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:49.157+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:45:49.153 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:49.157+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:45:52.331 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:45:52.333+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:45:55.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:55.561+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:45:55.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:45:55.561+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:45:57.331 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:45:57.333+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:46:02.331 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:46:02.333+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:46:07.331 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:46:07.333+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:46:08.363 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:08.365+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:46:08.367 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:08.369+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:46:12.331 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:46:12.333+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:46:12.936 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:12.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:46:12.936 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:12.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:46:12.937 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:12.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:46:12.937 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:12.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200067c0 con 0x7fdd20009750 2021-03-09T08:46:12.937 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:12.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c8d0 con 0x7fdd2000cfb0 2021-03-09T08:46:12.937 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:12.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20010c50 con 0x7fdd20006b10 2021-03-09T08:46:12.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:12.941+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:46:12.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:12.941+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:46:13.142 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:13.145+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:46:13.143 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:13.145+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:46:13.546 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:13.549+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:46:13.547 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:13.549+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:46:14.350 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:14.353+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:46:14.351 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:14.353+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:46:15.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:15.957+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:46:15.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:15.957+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:46:17.332 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:46:17.337+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:46:17.333 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:17.337+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T08:46:17.333 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:17.337+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:46:17.333 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:17.337+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=301 cs=1 l=1).handle_message read tag failed 2021-03-09T08:46:17.334 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:17.337+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=301 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:46:19.158 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:19.161+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:46:19.159 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:19.161+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:46:22.332 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:46:22.337+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:46:25.565 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:25.565+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:46:25.565 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:25.565+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:46:27.332 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:46:27.337+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:46:32.333 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:46:32.337+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:46:37.333 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:46:37.332+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:46:38.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:38.380+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:46:38.379 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:38.384+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:46:42.334 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:46:42.335+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:46:42.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:42.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:46:42.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:42.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000cfb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:46:42.938 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:42.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:46:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:42.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000a240 con 0x7fdd20009750 2021-03-09T08:46:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:42.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200067c0 con 0x7fdd20011330 2021-03-09T08:46:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:42.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c8d0 con 0x7fdd20006b10 2021-03-09T08:46:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:42.939+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:46:42.940 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:42.939+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd20013720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:46:43.139 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:43.143+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:46:43.140 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:43.143+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd20013720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:46:43.544 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:43.547+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:46:43.544 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:43.547+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd20013720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:46:44.348 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:44.351+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:46:44.349 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:44.351+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd20013720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:46:45.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:45.955+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:46:45.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:45.955+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd20013720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:46:47.335 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:46:47.334+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:46:47.336 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:47.334+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T08:46:47.336 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:47.334+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:46:47.336 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:47.334+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=318 cs=1 l=1).handle_message read tag failed 2021-03-09T08:46:47.337 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:47.334+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=318 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:46:49.156 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:49.158+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:46:49.157 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:49.158+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd20013720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:46:52.336 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:46:52.334+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:46:55.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:55.565+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:46:55.564 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:46:55.565+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd20013720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:46:57.337 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:46:57.337+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:47:02.337 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:47:02.336+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:47:07.338 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:47:07.336+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:47:08.377 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:08.376+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:47:08.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:08.376+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd20013720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:47:12.338 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:47:12.339+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:47:12.941 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:12.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:47:12.941 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:12.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd20013720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:47:12.942 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:12.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:47:12.942 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:12.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000a410 con 0x7fdd20009750 2021-03-09T08:47:12.942 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:12.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000a240 con 0x7fdd20011330 2021-03-09T08:47:12.942 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:12.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200067c0 con 0x7fdd20006b10 2021-03-09T08:47:12.943 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:12.939+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:47:12.943 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:12.939+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:47:13.143 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:13.143+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:47:13.143 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:13.143+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:47:13.546 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:13.547+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:47:13.547 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:13.547+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:47:14.351 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:14.351+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:47:14.351 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:14.351+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:47:15.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:15.955+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:47:15.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:15.955+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:47:17.339 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:47:17.339+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:47:17.340 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:17.339+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T08:47:17.340 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:17.339+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:47:17.340 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:17.339+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=335 cs=1 l=1).handle_message read tag failed 2021-03-09T08:47:17.340 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:17.339+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=335 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:47:19.158 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:19.159+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:47:19.159 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:19.159+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:47:22.339 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:47:22.339+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:47:25.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:25.562+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:47:25.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:25.562+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:47:27.340 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:47:27.338+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:47:32.340 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:47:32.338+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:47:37.340 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:47:37.338+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:47:38.376 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:38.374+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:47:38.377 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:38.374+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:47:42.341 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:47:42.337+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:47:42.943 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:42.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:47:42.943 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:42.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:47:42.943 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:42.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20009750 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:47:42.944 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:42.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c8d0 con 0x7fdd20011710 2021-03-09T08:47:42.944 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:42.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000a410 con 0x7fdd20011330 2021-03-09T08:47:42.944 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:42.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000a240 con 0x7fdd20006b10 2021-03-09T08:47:42.944 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:42.941+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20013b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:47:42.945 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:42.941+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:47:43.148 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:43.145+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20013b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:47:43.148 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:43.145+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:47:43.552 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:43.549+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20013b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:47:43.552 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:43.549+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:47:44.356 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:44.353+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20013b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:47:44.356 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:44.353+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:47:45.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:45.957+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20013b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:47:45.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:45.957+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:47:47.341 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:47:47.341+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:47:47.342 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:47.341+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T08:47:47.342 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:47.341+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:47:47.342 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:47.341+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=352 cs=1 l=1).handle_message read tag failed 2021-03-09T08:47:47.343 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:47.341+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=352 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:47:49.161 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:49.161+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20013b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:47:49.161 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:49.161+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:47:52.342 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:47:52.337+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:47:55.568 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:55.565+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20013b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:47:55.569 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:47:55.565+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:47:57.342 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:47:57.341+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:48:02.342 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:48:02.336+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:48:07.343 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:48:07.340+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:48:08.379 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:08.376+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:48:08.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:08.376+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20013b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:48:12.343 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:48:12.340+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:48:12.944 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:12.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:48:12.944 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:12.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:48:12.944 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:12.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20013b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:48:12.944 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:12.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20006950 con 0x7fdd20011710 2021-03-09T08:48:12.945 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:12.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c8d0 con 0x7fdd20011330 2021-03-09T08:48:12.945 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:12.940+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:48:12.945 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:12.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000a410 con 0x7fdd20006b10 2021-03-09T08:48:12.945 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:12.940+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:48:13.144 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:13.144+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:48:13.145 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:13.144+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:48:13.548 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:13.548+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:48:13.549 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:13.548+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:48:14.352 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:14.352+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:48:14.353 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:14.352+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:48:15.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:15.956+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:48:15.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:15.956+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:48:17.343 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:48:17.340+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:48:17.344 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:17.340+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T08:48:17.344 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:17.340+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:48:17.345 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:17.340+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=369 cs=1 l=1).handle_message read tag failed 2021-03-09T08:48:17.345 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:17.340+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=369 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:48:19.160 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:19.160+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:48:19.161 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:19.160+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:48:22.344 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:48:22.339+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:48:25.567 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:25.563+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:48:25.568 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:25.563+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:48:27.344 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:48:27.339+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:48:32.344 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:48:32.339+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:48:37.344 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:48:37.339+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:48:38.373 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:38.371+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:48:38.380 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:38.379+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:48:42.344 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:48:42.343+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:48:42.944 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:42.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:48:42.945 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:42.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:48:42.945 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:42.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011710 legacy=0x7fdd20009b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:48:42.945 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:42.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20014b20 con 0x7fdd20011af0 2021-03-09T08:48:42.945 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:42.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20006950 con 0x7fdd20011330 2021-03-09T08:48:42.945 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:42.939+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c8d0 con 0x7fdd20006b10 2021-03-09T08:48:42.946 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:42.939+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:48:42.946 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:42.939+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:48:43.145 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:43.143+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:48:43.145 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:43.143+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:48:43.549 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:43.547+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:48:43.549 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:43.547+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:48:44.353 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:44.351+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:48:44.353 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:44.351+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:48:45.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:45.955+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:48:45.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:45.955+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:48:47.345 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:48:47.343+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:48:47.346 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:47.343+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T08:48:47.346 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:47.343+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:48:47.346 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:47.343+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=386 cs=1 l=1).handle_message read tag failed 2021-03-09T08:48:47.347 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:47.343+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=386 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:48:49.161 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:49.158+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:48:49.161 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:49.158+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:48:52.345 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:48:52.342+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:48:55.565 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:55.562+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:48:55.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:48:55.562+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:48:57.346 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:48:57.342+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:49:02.346 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:49:02.342+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:49:07.346 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:49:07.341+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:49:08.369 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:08.365+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:49:08.370 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:08.365+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:49:12.347 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:49:12.341+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:49:12.946 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:12.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:49:12.946 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:12.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20011330 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:49:12.946 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:12.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:49:12.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:12.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20014640 con 0x7fdd20011af0 2021-03-09T08:49:12.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:12.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20014b20 con 0x7fdd20009b30 2021-03-09T08:49:12.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:12.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20006950 con 0x7fdd20006b10 2021-03-09T08:49:12.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:12.941+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:49:12.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:12.941+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:49:13.149 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:13.145+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:49:13.150 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:13.145+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:49:13.553 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:13.549+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:49:13.554 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:13.549+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:49:14.357 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:14.353+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:49:14.358 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:14.353+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:49:15.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:15.957+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:49:15.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:15.957+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:49:17.347 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:49:17.345+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:49:17.348 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:17.345+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T08:49:17.348 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:17.345+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:49:17.348 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:17.345+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=403 cs=1 l=1).handle_message read tag failed 2021-03-09T08:49:17.348 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:17.345+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=403 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:49:19.165 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:19.161+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:49:19.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:19.161+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:49:22.348 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:49:22.345+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:49:25.572 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:25.569+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:49:25.573 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:25.569+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:49:27.348 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:49:27.345+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:49:32.348 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:49:32.345+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:49:37.348 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:49:37.340+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:49:38.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:38.372+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:49:38.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:38.372+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:49:42.348 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:49:42.344+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:49:42.946 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:42.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:49:42.946 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:42.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200053d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:49:42.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:42.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20011af0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:49:42.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:42.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20014830 con 0x7fdd20005ae0 2021-03-09T08:49:42.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:42.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20014640 con 0x7fdd20009b30 2021-03-09T08:49:42.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:42.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20014b20 con 0x7fdd20006b10 2021-03-09T08:49:42.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:42.940+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:49:42.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:42.940+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:49:43.149 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:43.144+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:49:43.150 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:43.144+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:49:43.550 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:43.548+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:49:43.551 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:43.548+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:49:44.358 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:44.352+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:49:44.358 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:44.352+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:49:45.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:45.956+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:49:45.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:45.956+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:49:47.349 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:47.344+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T08:49:47.349 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:47.344+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:49:47.350 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:47.344+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=424 cs=1 l=1).handle_message read tag failed 2021-03-09T08:49:47.350 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:47.344+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=424 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:49:47.351 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:49:47.344+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:49:49.163 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:49.160+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:49:49.163 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:49.160+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:49:52.349 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:49:52.344+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:49:55.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:55.568+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:49:55.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:49:55.568+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:49:57.349 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:49:57.344+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:50:02.349 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:50:02.348+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:50:07.350 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:50:07.348+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:50:08.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:08.376+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:50:08.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:08.380+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:50:12.350 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:50:12.347+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:50:12.946 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:12.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:50:12.946 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:12.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:50:12.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:12.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:50:12.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:12.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20009f10 con 0x7fdd20005ae0 2021-03-09T08:50:12.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:12.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20014830 con 0x7fdd20009b30 2021-03-09T08:50:12.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:12.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20014640 con 0x7fdd20006b10 2021-03-09T08:50:12.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:12.943+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:50:12.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:12.943+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:50:13.149 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:13.147+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:50:13.150 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:13.147+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:50:13.553 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:13.551+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:50:13.554 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:13.551+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:50:14.358 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:14.355+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:50:14.358 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:14.355+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:50:15.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:15.959+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:50:15.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:15.959+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:50:17.350 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:50:17.347+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:50:17.351 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:17.347+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T08:50:17.351 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:17.347+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:50:17.352 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:17.347+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=461 cs=1 l=1).handle_message read tag failed 2021-03-09T08:50:17.352 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:17.347+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=461 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:50:19.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:19.163+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:50:19.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:19.163+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:50:22.351 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:50:22.347+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:50:25.572 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:25.567+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:50:25.573 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:25.567+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:50:27.351 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:50:27.347+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:50:32.351 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:50:32.347+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:50:37.351 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:50:37.347+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:50:38.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:38.375+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:50:38.385 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:38.379+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:50:42.351 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:50:42.347+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:50:42.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:42.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:50:42.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:42.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:50:42.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:42.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ae0 legacy=0x7fdd20013ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:50:42.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:42.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20009f10 con 0x7fdd20005ec0 2021-03-09T08:50:42.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:42.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20014830 con 0x7fdd20009b30 2021-03-09T08:50:42.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:42.943+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ec0 legacy=0x7fdd200043d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:50:42.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:42.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20004ae0 con 0x7fdd20006b10 2021-03-09T08:50:42.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:42.943+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:50:43.149 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:43.147+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ec0 legacy=0x7fdd200043d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:50:43.150 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:43.147+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:50:43.553 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:43.551+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ec0 legacy=0x7fdd200043d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:50:43.554 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:43.551+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:50:44.357 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:44.355+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ec0 legacy=0x7fdd200043d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:50:44.358 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:44.355+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:50:45.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:45.959+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ec0 legacy=0x7fdd200043d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:50:45.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:45.959+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:50:47.352 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:47.347+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T08:50:47.353 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:47.347+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:50:47.353 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:47.347+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=498 cs=1 l=1).handle_message read tag failed 2021-03-09T08:50:47.353 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:47.347+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=498 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:50:47.353 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:50:47.347+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:50:49.165 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:49.163+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ec0 legacy=0x7fdd200043d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:50:49.165 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:49.163+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:50:52.353 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:50:52.351+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:50:55.571 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:55.566+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ec0 legacy=0x7fdd200043d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:50:55.572 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:50:55.566+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:50:57.353 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:50:57.350+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:51:02.353 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:51:02.350+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:51:07.353 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:51:07.350+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:51:08.384 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:08.382+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ec0 legacy=0x7fdd200043d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:51:08.385 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:08.382+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:51:12.353 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:51:12.350+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:51:12.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:12.942+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:51:12.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:12.942+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:51:12.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:12.942+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005ec0 legacy=0x7fdd200043d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:51:12.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:12.942+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20013ef0 con 0x7fdd200140c0 2021-03-09T08:51:12.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:12.942+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20009f10 con 0x7fdd20009b30 2021-03-09T08:51:12.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:12.942+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20014830 con 0x7fdd20006b10 2021-03-09T08:51:12.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:12.942+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200140c0 legacy=0x7fdd20004c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:51:12.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:12.942+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:51:13.149 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:13.146+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200140c0 legacy=0x7fdd20004c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:51:13.150 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:13.146+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:51:13.553 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:13.550+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200140c0 legacy=0x7fdd20004c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:51:13.554 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:13.550+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:51:14.357 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:14.354+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200140c0 legacy=0x7fdd20004c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:51:14.358 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:14.354+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:51:15.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:15.958+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200140c0 legacy=0x7fdd20004c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:51:15.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:15.958+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:51:17.354 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:51:17.350+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:51:17.355 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:17.350+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T08:51:17.356 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:17.350+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:51:17.356 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:17.350+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=531 cs=1 l=1).handle_message read tag failed 2021-03-09T08:51:17.356 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:17.350+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=531 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:51:19.165 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:19.162+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200140c0 legacy=0x7fdd20004c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:51:19.165 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:19.162+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:51:22.354 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:51:22.350+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:51:25.571 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:25.570+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200140c0 legacy=0x7fdd20004c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:51:25.572 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:25.570+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:51:27.354 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:51:27.350+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:51:32.354 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:51:32.350+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:51:37.355 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:51:37.350+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:51:38.382 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:38.378+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200140c0 legacy=0x7fdd20004c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:51:38.384 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:38.378+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:51:42.355 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:51:42.353+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:51:42.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:42.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:51:42.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:42.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:51:42.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:42.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200140c0 legacy=0x7fdd20004c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:51:42.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:42.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144f0 con 0x7fdd200043d0 2021-03-09T08:51:42.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:42.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20013ef0 con 0x7fdd20009b30 2021-03-09T08:51:42.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:42.941+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20009f10 con 0x7fdd20006b10 2021-03-09T08:51:42.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:42.941+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200043d0 legacy=0x7fdd20005380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:51:42.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:42.941+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:51:43.149 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:43.145+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200043d0 legacy=0x7fdd20005380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:51:43.150 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:43.145+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:51:43.553 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:43.549+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200043d0 legacy=0x7fdd20005380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:51:43.554 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:43.549+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:51:44.357 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:44.353+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200043d0 legacy=0x7fdd20005380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:51:44.358 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:44.353+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:51:45.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:45.957+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200043d0 legacy=0x7fdd20005380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:51:45.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:45.957+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:51:47.355 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:51:47.353+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:51:47.356 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:47.353+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T08:51:47.356 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:47.353+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:51:47.356 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:47.353+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=548 cs=1 l=1).handle_message read tag failed 2021-03-09T08:51:47.357 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:47.353+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=548 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:51:49.165 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:49.161+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200043d0 legacy=0x7fdd20005380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:51:49.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:49.161+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:51:52.355 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:51:52.353+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:51:55.572 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:55.565+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200043d0 legacy=0x7fdd20005380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:51:55.572 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:51:55.565+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:51:57.355 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:51:57.349+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:52:02.356 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:52:02.349+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:52:07.356 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:52:07.353+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:52:08.375 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:08.373+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:52:08.385 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:08.377+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200043d0 legacy=0x7fdd20005380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:52:12.356 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:52:12.353+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:52:12.947 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:12.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:52:12.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:12.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:52:12.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:12.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200043d0 legacy=0x7fdd20005380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:52:12.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:12.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20014830 con 0x7fdd20004c70 2021-03-09T08:52:12.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:12.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144f0 con 0x7fdd20009b30 2021-03-09T08:52:12.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:12.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20013ef0 con 0x7fdd20006b10 2021-03-09T08:52:12.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:12.945+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200169f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:52:12.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:12.945+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:52:13.153 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:13.149+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200169f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:52:13.154 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:13.149+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:52:13.557 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:13.553+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200169f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:52:13.557 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:13.553+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:52:14.358 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:14.357+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200169f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:52:14.358 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:14.357+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:52:15.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:15.961+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200169f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:52:15.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:15.961+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:52:17.356 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:52:17.353+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:52:17.357 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:17.353+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T08:52:17.357 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:17.353+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:52:17.358 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:17.353+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=565 cs=1 l=1).handle_message read tag failed 2021-03-09T08:52:17.358 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:17.353+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=565 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:52:19.169 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:19.165+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200169f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:52:19.169 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:19.165+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:52:22.357 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:52:22.353+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:52:25.573 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:25.568+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:52:25.575 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:25.568+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200169f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:52:27.357 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:52:27.352+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:52:32.357 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:52:32.352+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:52:37.357 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:52:37.352+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:52:38.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:38.384+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:52:38.388 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:38.384+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200169f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:52:42.357 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:52:42.356+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:52:42.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:42.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:52:42.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:42.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20009b30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:52:42.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:42.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200169f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:52:42.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:42.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20004c70 2021-03-09T08:52:42.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:42.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20014830 con 0x7fdd20005050 2021-03-09T08:52:42.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:42.940+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:52:42.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:42.940+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144f0 con 0x7fdd20006b10 2021-03-09T08:52:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:42.940+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:52:43.148 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:43.144+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:52:43.148 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:43.144+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:52:43.553 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:43.548+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:52:43.553 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:43.548+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:52:44.354 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:44.352+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:52:44.354 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:44.352+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:52:45.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:45.956+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:52:45.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:45.956+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:52:47.358 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:47.352+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T08:52:47.358 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:47.352+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:52:47.358 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:47.352+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=582 cs=1 l=1).handle_message read tag failed 2021-03-09T08:52:47.359 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:47.352+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=582 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:52:47.359 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:52:47.352+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:52:49.164 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:49.160+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:52:49.165 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:49.160+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:52:52.358 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:52:52.356+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:52:55.569 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:55.568+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:52:55.569 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:52:55.568+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:52:57.358 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:52:57.356+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:53:02.358 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:53:02.356+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:53:07.358 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:53:07.356+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:53:08.382 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:08.379+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:53:08.382 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:08.379+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:53:12.358 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:53:12.355+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:53:12.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:12.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:53:13.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:12.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:53:13.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:12.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:53:13.233 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:12.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20005430 2021-03-09T08:53:13.233 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:12.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20014830 con 0x7fdd20005050 2021-03-09T08:53:13.233 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:12.943+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:53:13.233 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:12.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144f0 con 0x7fdd20006b10 2021-03-09T08:53:13.234 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:12.943+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:53:13.234 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:13.147+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:53:13.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:13.147+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:53:13.555 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:13.551+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:53:13.555 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:13.551+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:53:14.357 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:14.355+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:53:14.357 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:14.355+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:53:15.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:15.959+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:53:15.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:15.959+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:53:17.359 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:53:17.355+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:53:17.359 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:17.355+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T08:53:17.359 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:17.355+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:53:17.360 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:17.355+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=599 cs=1 l=1).handle_message read tag failed 2021-03-09T08:53:17.360 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:17.355+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=599 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:53:19.165 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:19.163+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:53:19.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:19.163+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:53:22.359 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:53:22.355+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:53:25.571 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:25.567+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:53:25.572 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:25.567+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:53:27.359 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:53:27.355+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:53:32.359 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:53:32.355+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:53:37.359 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:53:37.355+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:53:38.384 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:38.379+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:53:38.385 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:38.383+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:53:42.359 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:53:42.359+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:53:42.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:42.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:53:42.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:42.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:53:42.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:42.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:53:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:42.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20013ef0 con 0x7fdd20005430 2021-03-09T08:53:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:42.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20005050 2021-03-09T08:53:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:42.943+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:53:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:42.943+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20014830 con 0x7fdd20006b10 2021-03-09T08:53:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:42.943+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:53:43.148 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:43.147+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:53:43.149 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:43.147+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:53:43.552 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:43.551+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:53:43.553 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:43.551+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:53:44.357 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:44.355+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:53:44.357 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:44.355+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:53:45.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:45.959+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:53:45.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:45.959+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:53:47.360 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:47.359+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T08:53:47.361 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:47.359+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:53:47.361 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:47.359+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=616 cs=1 l=1).handle_message read tag failed 2021-03-09T08:53:47.361 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:47.359+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=616 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:53:47.362 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:53:47.359+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:53:49.164 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:49.163+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:53:49.165 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:49.163+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:53:52.360 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:53:52.359+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:53:55.571 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:55.566+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:53:55.571 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:53:55.566+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:53:57.361 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:53:57.358+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:54:02.361 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:54:02.358+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:54:07.362 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:54:07.358+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:54:08.384 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:08.382+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:54:08.384 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:08.382+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:54:12.361 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:54:12.358+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:54:12.948 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:12.946+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:54:12.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:12.946+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:54:12.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:12.946+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:54:12.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:12.946+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144d0 con 0x7fdd20004c70 2021-03-09T08:54:12.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:12.946+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20013ef0 con 0x7fdd20005050 2021-03-09T08:54:12.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:12.946+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T08:54:12.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:12.946+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:54:12.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:12.946+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:54:13.152 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:13.150+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:54:13.153 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:13.150+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:54:13.556 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:13.554+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:54:13.557 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:13.554+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:54:14.360 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:14.358+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:54:14.361 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:14.358+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:54:15.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:15.962+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:54:15.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:15.962+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:54:17.361 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:54:17.358+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:54:17.362 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:17.358+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T08:54:17.362 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:17.358+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:54:17.363 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:17.358+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=633 cs=1 l=1).handle_message read tag failed 2021-03-09T08:54:17.363 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:17.358+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=633 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:54:19.168 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:19.166+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:54:19.168 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:19.166+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:54:22.361 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:54:22.358+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:54:25.576 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:25.570+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:54:25.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:25.570+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:54:27.362 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:54:27.358+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:54:32.362 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:54:32.358+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:54:37.362 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:54:37.362+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:54:38.385 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:38.381+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:54:38.387 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:38.381+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:54:42.362 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:54:42.361+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:54:42.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:42.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:54:42.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:42.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:54:42.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:42.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20004c70 legacy=0x7fdd20003ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:54:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:42.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20015840 con 0x7fdd20005430 2021-03-09T08:54:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:42.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144d0 con 0x7fdd20005050 2021-03-09T08:54:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:42.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20013ef0 con 0x7fdd20006b10 2021-03-09T08:54:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:42.945+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:54:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:42.945+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:54:43.153 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:43.149+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:54:43.153 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:43.149+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:54:43.556 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:43.553+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:54:43.557 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:43.553+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:54:44.360 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:44.357+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:54:44.361 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:44.357+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:54:45.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:45.961+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:54:45.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:45.961+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:54:47.362 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:54:47.361+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:54:47.364 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:47.361+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T08:54:47.364 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:47.361+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:54:47.364 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:47.361+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=650 cs=1 l=1).handle_message read tag failed 2021-03-09T08:54:47.364 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:47.361+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=650 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:54:49.168 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:49.165+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:54:49.169 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:49.165+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:54:52.362 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:54:52.361+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:54:55.573 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:55.569+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:54:55.575 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:54:55.569+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:54:57.363 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:54:57.357+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:55:02.363 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:55:02.357+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:55:07.363 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:55:07.361+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:55:08.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:08.377+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:55:08.387 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:08.381+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:55:12.363 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:55:12.361+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:55:12.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:12.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:55:12.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:12.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:55:12.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:12.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:55:12.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:12.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20005430 2021-03-09T08:55:12.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:12.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20015840 con 0x7fdd20005050 2021-03-09T08:55:12.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:12.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144d0 con 0x7fdd20006b10 2021-03-09T08:55:12.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:12.945+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:55:12.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:12.945+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:55:13.154 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:13.149+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:55:13.154 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:13.149+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:55:13.556 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:13.553+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:55:13.556 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:13.553+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:55:14.357 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:14.357+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:55:14.358 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:14.357+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:55:15.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:15.961+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:55:15.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:15.961+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:55:17.364 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:55:17.357+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:55:17.365 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:17.357+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T08:55:17.365 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:17.357+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:55:17.365 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:17.357+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=667 cs=1 l=1).handle_message read tag failed 2021-03-09T08:55:17.366 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:17.357+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=667 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:55:19.168 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:19.165+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:55:19.169 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:19.165+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:55:22.364 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:55:22.357+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:55:25.572 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:25.568+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:55:25.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:25.568+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:55:27.364 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:55:27.360+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:55:32.364 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:55:32.360+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:55:37.364 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:55:37.364+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:55:38.385 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:38.384+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:55:38.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:38.384+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:55:39.089 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:39.088+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000323) for more than 900000000 us, fault. 2021-03-09T08:55:39.090 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:39.088+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 0x7fdd2405ba90 :-1 s=OPENED pgs=31 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:55:39.090 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:39.088+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405ba90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:55:42.364 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:55:42.360+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:55:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:42.944+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:55:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:42.944+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:55:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:42.944+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:55:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:42.944+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003ad0 2021-03-09T08:55:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:42.944+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20015840 con 0x7fdd20005050 2021-03-09T08:55:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:42.944+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T08:55:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:42.944+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003ad0 legacy=0x7fdd200179e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:55:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:42.944+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:55:43.152 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:43.148+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003ad0 legacy=0x7fdd200179e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:55:43.153 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:43.148+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:55:43.556 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:43.552+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003ad0 legacy=0x7fdd200179e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:55:43.556 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:43.552+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:55:44.360 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:44.356+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003ad0 legacy=0x7fdd200179e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:55:44.360 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:44.356+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:55:45.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:45.960+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003ad0 legacy=0x7fdd200179e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:55:45.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:45.960+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:55:47.365 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:47.364+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T08:55:47.365 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:47.364+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:55:47.365 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:47.364+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=684 cs=1 l=1).handle_message read tag failed 2021-03-09T08:55:47.366 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:55:47.364+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:55:47.366 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:47.364+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=684 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:55:49.168 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:49.164+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003ad0 legacy=0x7fdd200179e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:55:49.168 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:49.164+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:55:52.365 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:55:52.364+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:55:55.575 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:55.572+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003ad0 legacy=0x7fdd200179e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:55:55.575 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:55:55.572+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:55:57.365 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:55:57.364+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:56:02.365 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:56:02.364+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:56:07.365 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:56:07.364+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:56:08.377 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:08.376+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:56:08.383 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:08.380+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003ad0 legacy=0x7fdd200179e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:56:12.365 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:56:12.363+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:56:12.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:12.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:56:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:12.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:56:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:12.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003ad0 legacy=0x7fdd200179e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:56:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:12.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003eb0 con 0x7fdd20005430 2021-03-09T08:56:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:12.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20005050 2021-03-09T08:56:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:12.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20015840 con 0x7fdd20006b10 2021-03-09T08:56:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:12.947+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:56:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:12.947+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:56:13.152 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:13.151+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:56:13.152 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:13.151+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:56:13.556 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:13.555+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:56:13.556 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:13.555+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:56:14.360 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:14.359+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:56:14.360 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:14.359+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:56:15.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:15.963+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:56:15.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:15.963+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:56:17.366 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:17.363+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T08:56:17.366 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:17.363+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:56:17.367 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:56:17.363+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:56:17.367 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:17.363+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=701 cs=1 l=1).handle_message read tag failed 2021-03-09T08:56:17.367 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:17.363+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=701 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:56:19.168 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:19.167+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:56:19.168 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:19.167+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:56:22.366 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:56:22.363+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:56:25.572 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:25.571+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:56:25.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:25.571+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:56:27.366 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:56:27.363+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:56:32.366 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:56:32.363+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:56:37.366 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:56:37.363+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:56:38.379 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:38.379+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:56:38.385 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:38.383+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:56:42.366 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:56:42.363+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:56:42.949 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:42.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:56:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:42.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:56:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:42.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005430 legacy=0x7fdd200033c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:56:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:42.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20015840 2021-03-09T08:56:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:42.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003eb0 con 0x7fdd20005050 2021-03-09T08:56:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:42.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T08:56:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:42.947+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:56:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:42.947+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015840 legacy=0x7fdd20017c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:56:43.152 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:43.151+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015840 legacy=0x7fdd20017c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:56:43.152 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:43.151+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:56:43.556 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:43.555+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015840 legacy=0x7fdd20017c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:56:43.556 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:43.555+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:56:44.360 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:44.359+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015840 legacy=0x7fdd20017c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:56:44.360 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:44.359+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:56:45.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:45.963+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015840 legacy=0x7fdd20017c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:56:45.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:45.963+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:56:47.367 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:56:47.363+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:56:47.736 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:47.363+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T08:56:47.736 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:47.363+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:56:47.736 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:47.363+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=718 cs=1 l=1).handle_message read tag failed 2021-03-09T08:56:47.736 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:47.363+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=718 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:56:49.168 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:49.167+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015840 legacy=0x7fdd20017c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:56:49.169 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:49.167+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:56:52.367 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:56:52.363+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:56:55.572 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:55.570+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015840 legacy=0x7fdd20017c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:56:55.572 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:56:55.570+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:56:57.367 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:56:57.366+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:57:02.368 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:57:02.366+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:57:07.368 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:57:07.366+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:57:08.377 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:08.374+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015840 legacy=0x7fdd20017c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:57:08.385 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:08.382+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:57:12.368 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:57:12.366+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:57:12.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:12.946+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:57:12.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:12.946+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:57:12.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:12.946+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015840 legacy=0x7fdd20017c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:57:12.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:12.946+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd200033c0 2021-03-09T08:57:12.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:12.946+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20005050 2021-03-09T08:57:12.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:12.946+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003eb0 con 0x7fdd20006b10 2021-03-09T08:57:12.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:12.946+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:57:12.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:12.946+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:57:13.152 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:13.150+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:57:13.152 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:13.150+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:57:13.555 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:13.554+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:57:13.556 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:13.554+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:57:14.360 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:14.358+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:57:14.360 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:14.358+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:57:15.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:15.962+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:57:15.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:15.962+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:57:17.368 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:57:17.366+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:57:17.370 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:17.366+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T08:57:17.370 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:17.366+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:57:17.371 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:17.366+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=735 cs=1 l=1).handle_message read tag failed 2021-03-09T08:57:17.371 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:17.366+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=735 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:57:19.168 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:19.166+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:57:19.168 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:19.166+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:57:22.368 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:57:22.366+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:57:25.571 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:25.570+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:57:25.572 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:25.570+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:57:27.368 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:57:27.366+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:57:32.369 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:57:32.366+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:57:37.369 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:57:37.366+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:57:38.379 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:38.374+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:57:38.380 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:38.378+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:57:42.369 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:57:42.365+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:57:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:42.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:57:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:42.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:57:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:42.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:57:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:42.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd200033c0 2021-03-09T08:57:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:42.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20005050 2021-03-09T08:57:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:42.945+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T08:57:42.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:42.945+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:57:42.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:42.945+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:57:43.151 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:43.149+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:57:43.151 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:43.149+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:57:43.555 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:43.553+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:57:43.556 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:43.553+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:57:44.359 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:44.357+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:57:44.360 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:44.357+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:57:45.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:45.961+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:57:45.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:45.961+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:57:47.370 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:57:47.369+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:57:47.371 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:47.369+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T08:57:47.371 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:47.369+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:57:47.372 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:47.369+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=752 cs=1 l=1).handle_message read tag failed 2021-03-09T08:57:47.372 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:47.369+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=752 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:57:49.167 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:49.165+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:57:49.168 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:49.165+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:57:52.370 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:57:52.369+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:57:55.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:55.573+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:57:55.575 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:57:55.573+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:57:57.370 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:57:57.365+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:58:02.371 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:58:02.365+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:58:07.370 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:58:07.369+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:58:08.387 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:08.385+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:58:08.388 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:08.385+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:58:12.370 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:58:12.365+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:58:12.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:12.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:58:12.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:12.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:58:12.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:12.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:58:12.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:12.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200037a0 con 0x7fdd200033c0 2021-03-09T08:58:12.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:12.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20005050 2021-03-09T08:58:12.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:12.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T08:58:12.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:12.949+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:58:12.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:12.949+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:58:13.155 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:13.153+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:58:13.155 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:13.153+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:58:13.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:13.557+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:58:13.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:13.557+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:58:14.360 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:14.361+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:58:14.361 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:14.361+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:58:15.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:15.965+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:58:15.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:15.965+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:58:17.370 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:58:17.369+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:58:17.371 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:17.369+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T08:58:17.371 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:17.369+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:58:17.372 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:17.369+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=769 cs=1 l=1).handle_message read tag failed 2021-03-09T08:58:17.372 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:17.369+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=769 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:58:19.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:19.169+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:58:19.172 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:19.169+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:58:22.371 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:58:22.369+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:58:25.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:25.577+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:58:25.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:25.577+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:58:27.371 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:58:27.368+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:58:32.371 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:58:32.368+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:58:37.371 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:58:37.368+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:58:38.385 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:38.384+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:58:38.391 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:38.388+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:58:42.375 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:58:42.372+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:58:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:42.944+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:58:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:42.944+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:58:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:42.944+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:58:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:42.944+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200033c0 2021-03-09T08:58:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:42.944+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200037a0 con 0x7fdd20005050 2021-03-09T08:58:42.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:42.944+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T08:58:42.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:42.944+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:58:42.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:42.944+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:58:43.150 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:43.148+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:58:43.151 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:43.148+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:58:43.555 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:43.552+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:58:43.555 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:43.552+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:58:44.356 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:44.356+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:58:44.357 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:44.356+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:58:45.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:45.960+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:58:45.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:45.960+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:58:47.371 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:58:47.368+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:58:47.372 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:47.368+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T08:58:47.373 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:47.368+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:58:47.373 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:47.368+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=786 cs=1 l=1).handle_message read tag failed 2021-03-09T08:58:47.373 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:47.368+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=786 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:58:49.165 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:49.164+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:58:49.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:49.164+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:58:52.372 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:58:52.372+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:58:55.572 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:55.572+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:58:55.573 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:58:55.572+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:58:57.372 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:58:57.372+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:59:02.372 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:59:02.372+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:59:07.373 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:59:07.372+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:59:08.385 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:08.384+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:59:08.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:08.384+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:59:12.373 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:59:12.371+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:59:12.950 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:12.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:59:12.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:12.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:59:12.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:12.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:59:12.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:12.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003eb0 2021-03-09T08:59:12.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:12.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20005050 2021-03-09T08:59:12.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:12.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200037a0 con 0x7fdd20006b10 2021-03-09T08:59:12.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:12.947+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:59:12.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:12.947+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:59:13.151 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:13.151+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:59:13.151 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:13.151+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:59:13.555 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:13.555+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:59:13.555 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:13.555+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:59:14.359 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:14.359+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:59:14.359 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:14.359+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:59:15.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:15.963+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:59:15.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:15.963+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:59:17.373 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:59:17.371+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:59:17.374 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:17.371+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T08:59:17.375 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:17.371+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:59:17.375 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:17.371+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=803 cs=1 l=1).handle_message read tag failed 2021-03-09T08:59:17.376 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:17.371+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=803 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:59:19.167 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:19.167+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:59:19.168 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:19.167+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:59:22.374 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:59:22.371+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:59:25.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:25.571+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:59:25.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:25.571+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:59:27.373 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:59:27.371+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:59:32.374 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:59:32.371+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:59:37.374 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:59:37.375+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:59:38.387 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:38.383+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:59:38.387 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:38.387+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:59:42.374 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:59:42.375+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:59:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:42.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T08:59:42.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:42.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:59:42.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:42.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T08:59:42.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:42.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd200033c0 2021-03-09T08:59:42.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:42.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20005050 2021-03-09T08:59:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:42.947+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T08:59:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:42.947+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:59:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:42.951+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:59:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:42.951+0000 7fdd492a2700 0 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-03-09T08:59:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:42.951+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T08:59:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:42.951+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T08:59:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:42.951+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=820 cs=1 l=1).handle_message read tag failed 2021-03-09T08:59:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:42.951+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=820 cs=1 l=1).fault on lossy channel, failing 2021-03-09T08:59:43.155 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:43.155+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:59:43.155 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:43.155+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:59:43.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:43.559+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:59:43.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:43.559+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:59:44.363 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:44.363+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:59:44.364 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:44.363+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:59:45.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:45.967+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:59:45.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:45.967+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:59:47.374 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:59:47.375+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:59:49.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:49.171+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:59:49.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:49.171+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:59:52.375 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:59:52.375+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T08:59:55.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:55.574+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T08:59:55.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T08:59:55.574+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T08:59:57.375 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T08:59:57.374+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:00:02.375 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:00:02.374+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:00:07.375 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:00:07.374+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:00:08.391 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:08.390+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:00:08.391 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:08.390+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:00:12.377 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:00:12.374+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:00:12.951 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:12.950+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:00:12.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:12.950+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:00:12.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:12.950+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:00:12.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:12.950+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200037a0 con 0x7fdd200033c0 2021-03-09T09:00:12.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:12.950+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20005050 2021-03-09T09:00:12.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:12.950+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:00:12.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:12.950+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:00:12.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:12.950+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:00:13.155 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:13.154+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:00:13.155 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:13.154+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:00:13.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:13.558+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:00:13.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:13.558+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:00:14.363 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:14.362+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:00:14.363 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:14.362+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:00:15.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:15.966+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:00:15.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:15.966+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:00:17.376 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:00:17.374+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:00:17.377 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:17.374+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:00:17.377 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:17.374+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:00:17.377 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:17.374+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=837 cs=1 l=1).handle_message read tag failed 2021-03-09T09:00:17.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:17.374+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=837 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:00:19.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:19.170+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:00:19.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:19.170+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:00:22.376 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:00:22.374+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:00:25.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:25.574+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:00:25.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:25.574+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:00:27.376 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:00:27.374+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:00:32.377 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:00:32.377+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:00:37.377 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:00:37.377+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:00:38.391 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:38.389+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:00:38.392 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:38.389+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:00:42.377 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:00:42.373+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:00:42.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:42.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:00:42.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:42.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:00:42.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:42.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200033c0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:00:42.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:42.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20005050 2021-03-09T09:00:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:42.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200037a0 con 0x7fdd20003eb0 2021-03-09T09:00:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:42.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:00:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:42.949+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:00:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:42.949+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:00:43.158 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:43.153+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:00:43.159 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:43.153+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:00:43.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:43.557+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:00:43.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:43.557+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:00:44.363 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:44.361+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:00:44.363 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:44.361+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:00:45.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:45.965+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:00:45.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:45.965+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:00:47.377 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:00:47.377+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:00:47.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:47.377+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:00:47.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:47.377+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:00:47.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:47.377+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=854 cs=1 l=1).handle_message read tag failed 2021-03-09T09:00:47.379 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:47.377+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=854 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:00:49.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:49.169+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:00:49.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:49.169+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:00:52.378 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:00:52.373+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:00:55.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:55.577+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:00:55.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:00:55.577+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:00:57.378 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:00:57.377+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:01:02.378 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:01:02.372+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:01:07.378 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:01:07.372+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:01:08.384 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:08.384+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:01:08.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:08.384+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:01:12.379 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:01:12.372+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:01:12.952 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:12.952+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:01:12.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:12.952+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:01:12.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:12.952+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:01:12.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:12.952+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20005050 2021-03-09T09:01:12.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:12.952+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:01:12.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:12.952+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200037a0 con 0x7fdd20006b10 2021-03-09T09:01:12.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:12.952+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:01:12.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:12.952+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:01:13.159 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:13.156+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:01:13.160 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:13.156+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:01:13.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:13.560+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:01:13.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:13.560+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:01:14.370 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:14.364+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:01:14.370 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:14.364+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:01:15.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:15.968+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:01:15.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:15.968+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:01:17.379 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:01:17.376+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:01:17.380 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:17.376+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:01:17.380 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:17.376+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:01:17.380 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:17.376+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=875 cs=1 l=1).handle_message read tag failed 2021-03-09T09:01:17.380 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:17.376+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=875 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:01:19.172 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:19.172+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:01:19.173 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:19.172+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:01:22.379 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:01:22.380+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:01:25.579 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:25.580+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:01:25.580 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:25.580+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:01:27.380 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:01:27.380+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:01:32.380 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:01:32.380+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:01:37.380 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:01:37.379+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:01:38.391 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:38.391+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:01:38.392 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:38.391+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:01:42.380 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:01:42.379+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:01:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:42.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:01:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:42.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:01:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:42.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:01:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:42.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003390 2021-03-09T09:01:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:42.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003eb0 2021-03-09T09:01:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:42.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:01:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:42.951+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:01:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:42.951+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:01:43.155 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:43.155+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:01:43.155 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:43.155+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:01:43.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:43.559+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:01:43.560 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:43.559+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:01:44.363 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:44.363+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:01:44.364 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:44.363+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:01:45.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:45.967+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:01:45.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:45.967+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:01:47.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:47.379+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:01:47.382 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:47.379+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:01:47.382 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:47.379+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=912 cs=1 l=1).handle_message read tag failed 2021-03-09T09:01:47.383 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:47.379+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=912 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:01:47.383 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:01:47.379+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:01:49.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:49.171+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:01:49.172 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:49.171+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:01:52.382 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:01:52.379+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:01:55.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:55.575+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:01:55.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:01:55.575+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:01:57.382 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:01:57.379+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:02:02.382 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:02:02.383+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:02:07.382 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:02:07.379+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:02:08.393 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:08.391+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:02:08.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:08.391+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:02:12.383 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:02:12.378+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:02:12.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:12.950+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:02:12.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:12.950+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:02:12.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:12.950+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:02:12.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:12.950+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20003390 2021-03-09T09:02:12.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:12.950+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:02:12.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:12.950+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:02:12.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:12.950+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:02:12.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:12.950+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:02:13.155 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:13.154+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:02:13.156 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:13.154+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:02:13.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:13.558+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:02:13.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:13.558+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:02:14.363 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:14.362+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:02:14.364 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:14.362+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:02:15.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:15.966+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:02:15.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:15.966+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:02:17.384 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:17.382+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:02:17.384 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:17.382+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:02:17.384 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:17.382+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=949 cs=1 l=1).handle_message read tag failed 2021-03-09T09:02:17.385 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:17.382+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=949 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:02:17.385 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:02:17.382+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:02:19.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:19.170+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:02:19.172 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:19.170+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:02:22.384 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:02:22.382+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:02:25.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:25.578+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:02:25.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:25.578+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:02:27.384 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:02:27.382+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:02:32.384 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:02:32.382+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:02:37.384 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:02:37.382+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:02:38.385 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:38.382+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:02:38.391 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:38.390+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:02:42.384 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:02:42.382+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:02:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:42.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:02:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:42.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:02:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:42.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:02:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:42.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20005050 2021-03-09T09:02:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:42.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20003eb0 2021-03-09T09:02:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:42.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:02:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:42.954+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20015f50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:02:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:42.954+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:02:43.159 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:43.158+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20015f50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:02:43.160 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:43.158+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:02:43.564 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:43.562+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20015f50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:02:44.463 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:43.562+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:02:44.464 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:44.366+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20015f50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:02:44.465 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:44.366+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:02:45.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:45.970+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20015f50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:02:45.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:45.970+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:02:47.387 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:02:47.382+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:02:47.388 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:47.382+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:02:47.389 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:47.382+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:02:47.389 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:47.382+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=982 cs=1 l=1).handle_message read tag failed 2021-03-09T09:02:47.389 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:47.382+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=982 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:02:49.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:49.174+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20015f50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:02:49.179 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:49.174+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:02:52.385 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:02:52.385+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:02:55.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:55.581+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20015f50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:02:55.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:02:55.581+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:02:57.385 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:02:57.385+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:03:02.385 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:03:02.385+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:03:07.386 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:03:07.385+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:03:08.395 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:08.393+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20015f50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:03:08.395 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:08.393+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:03:12.386 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:03:12.385+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:03:12.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:12.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:03:12.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:12.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:03:12.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:12.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20015f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:03:12.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:12.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20005050 2021-03-09T09:03:12.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:12.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003390 2021-03-09T09:03:12.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:12.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20006b10 2021-03-09T09:03:12.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:12.949+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:03:12.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:12.949+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:03:13.154 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:13.153+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:03:13.154 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:13.153+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:03:13.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:13.557+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:03:13.560 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:13.557+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:03:14.360 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:14.361+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:03:14.361 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:14.361+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:03:15.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:15.965+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:03:15.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:15.965+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:03:17.386 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:03:17.385+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:03:17.388 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:17.385+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:03:17.388 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:17.385+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:03:17.388 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:17.385+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=999 cs=1 l=1).handle_message read tag failed 2021-03-09T09:03:17.389 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:17.385+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=999 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:03:19.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:19.169+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:03:19.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:19.169+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:03:22.386 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:03:22.385+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:03:25.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:25.577+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:03:25.579 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:25.577+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:03:27.386 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:03:27.385+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:03:32.387 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:03:32.384+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:03:37.387 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:03:37.384+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:03:38.385 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:38.384+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:03:38.385 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:38.384+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:03:42.387 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:03:42.384+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:03:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:42.948+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:03:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:42.948+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:03:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:42.948+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:03:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:42.948+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:03:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:42.948+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003390 2021-03-09T09:03:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:42.948+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:03:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:42.948+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:03:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:42.948+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:03:43.155 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:43.152+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:03:43.155 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:43.152+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:03:43.556 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:43.556+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:03:43.556 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:43.556+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:03:44.363 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:44.360+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:03:44.363 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:44.360+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:03:45.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:45.964+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:03:45.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:45.964+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:03:47.387 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:03:47.388+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:03:47.388 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:47.388+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:03:47.388 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:47.388+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:03:47.389 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:47.388+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1016 cs=1 l=1).handle_message read tag failed 2021-03-09T09:03:47.389 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:47.388+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1016 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:03:49.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:49.168+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:03:49.172 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:49.168+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:03:52.388 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:03:52.388+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:03:55.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:55.576+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:03:55.579 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:03:55.576+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:03:57.388 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:03:57.388+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:04:02.388 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:04:02.388+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:04:07.389 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:04:07.388+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:04:08.391 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:08.392+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:04:08.392 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:08.392+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:04:12.388 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:04:12.387+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:04:12.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:12.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:04:12.954 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:12.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:04:12.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:12.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:04:12.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:12.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20003eb0 2021-03-09T09:04:12.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:12.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003390 2021-03-09T09:04:12.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:12.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:04:12.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:12.951+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:04:12.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:12.951+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:04:13.155 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:13.155+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:04:13.155 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:13.155+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:04:13.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:13.559+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:04:13.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:13.559+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:04:14.363 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:14.363+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:04:14.363 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:14.363+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:04:15.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:15.967+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:04:15.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:15.967+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:04:17.389 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:04:17.387+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:04:17.389 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:17.387+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:04:17.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:17.387+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:04:17.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:17.387+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1033 cs=1 l=1).handle_message read tag failed 2021-03-09T09:04:17.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:17.387+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1033 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:04:19.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:19.171+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:04:19.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:19.171+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:04:22.389 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:04:22.387+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:04:25.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:25.575+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:04:25.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:25.575+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:04:27.389 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:04:27.387+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:04:32.389 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:04:32.387+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:04:37.389 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:04:37.387+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:04:38.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:38.391+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:04:38.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:38.391+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:04:42.389 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:04:42.387+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:04:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:42.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:04:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:42.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:04:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:42.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:04:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:42.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20005050 2021-03-09T09:04:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:42.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20003390 2021-03-09T09:04:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:42.951+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:04:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:42.951+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:04:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:42.951+0000 7fdd492a2700 0 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2021-03-09T09:04:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:42.951+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send send error: (32) Broken pipe 2021-03-09T09:04:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:42.951+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2021-03-09T09:04:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:42.951+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:04:43.155 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:43.155+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:04:43.155 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:43.155+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:04:43.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:43.559+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:04:43.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:43.559+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:04:44.363 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:44.363+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:04:44.364 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:44.363+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:04:45.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:45.967+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:04:45.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:45.967+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:04:47.390 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:04:47.387+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:04:49.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:49.171+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:04:49.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:49.171+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:04:52.390 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:04:52.387+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:04:55.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:55.578+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:04:55.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:04:55.578+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:04:57.390 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:04:57.386+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:05:02.391 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:05:02.386+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:05:07.391 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:05:07.390+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:05:08.391 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:08.390+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:05:08.391 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:08.390+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:05:12.391 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:05:12.390+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:05:12.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:12.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:05:12.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:12.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:05:12.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:12.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:05:12.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:12.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20005050 2021-03-09T09:05:12.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:12.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003390 2021-03-09T09:05:12.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:12.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20006b10 2021-03-09T09:05:12.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:12.954+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:05:12.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:12.954+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:05:13.159 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:13.158+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:05:13.159 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:13.158+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:05:13.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:13.562+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:05:13.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:13.562+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:05:14.367 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:14.366+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:05:14.367 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:14.366+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:05:15.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:15.970+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:05:15.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:15.970+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:05:17.391 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:05:17.390+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:05:17.392 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:17.390+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:05:17.392 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:17.390+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:05:17.393 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:17.390+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1066 cs=1 l=1).handle_message read tag failed 2021-03-09T09:05:17.393 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:17.390+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1066 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:05:19.175 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:19.174+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:05:19.175 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:19.174+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:05:22.391 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:05:22.390+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:05:25.581 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:25.582+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:05:25.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:25.582+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:05:27.392 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:05:27.390+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:05:32.392 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:05:32.390+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:05:37.392 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:05:37.389+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:05:38.387 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:38.385+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:05:38.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:38.389+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:05:42.392 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:05:42.389+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:05:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:42.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:05:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:42.949+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:05:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:42.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:05:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:42.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:05:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:42.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003390 2021-03-09T09:05:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:42.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:05:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:42.953+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:05:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:42.953+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:05:43.158 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:43.157+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:05:43.159 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:43.157+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:05:43.562 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:43.561+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:05:43.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:43.561+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:05:44.367 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:44.365+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:05:44.367 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:44.365+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:05:45.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:45.969+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:05:45.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:45.969+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:05:47.393 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:05:47.389+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:05:47.393 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:47.389+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:05:47.393 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:47.389+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:05:47.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:47.389+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1083 cs=1 l=1).handle_message read tag failed 2021-03-09T09:05:47.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:47.389+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1083 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:05:49.175 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:49.173+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:05:49.176 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:49.173+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:05:52.393 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:05:52.389+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:05:55.581 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:55.577+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:05:55.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:05:55.577+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:05:57.393 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:05:57.393+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:06:02.393 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:06:02.393+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:06:07.393 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:06:07.393+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:06:08.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:08.393+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:06:08.395 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:08.393+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:06:12.394 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:06:12.393+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:06:12.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:12.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:06:12.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:12.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:06:12.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:12.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:06:12.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:12.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20005050 2021-03-09T09:06:12.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:12.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003390 2021-03-09T09:06:12.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:12.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:06:12.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:12.953+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:06:12.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:12.953+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:06:13.158 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:13.157+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:06:13.159 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:13.157+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:06:13.562 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:13.561+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:06:13.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:13.561+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:06:14.364 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:14.365+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:06:14.364 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:14.365+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:06:15.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:15.969+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:06:15.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:15.969+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:06:17.394 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:06:17.393+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:06:17.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:17.393+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:06:17.395 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:17.393+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:06:17.395 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:17.393+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1100 cs=1 l=1).handle_message read tag failed 2021-03-09T09:06:17.395 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:17.393+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1100 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:06:19.174 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:19.172+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:06:19.175 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:19.172+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:06:22.394 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:06:22.392+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:06:25.581 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:25.580+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:06:25.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:25.580+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:06:27.394 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:06:27.392+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:06:32.394 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:06:32.392+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:06:37.394 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:06:37.396+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:06:38.393 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:38.392+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:06:38.681 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:38.392+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:06:42.395 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:06:42.396+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:06:42.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:06:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:06:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:06:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20005050 2021-03-09T09:06:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20003390 2021-03-09T09:06:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:06:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:42.956+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:06:42.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:42.956+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:06:43.158 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:43.160+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:06:43.159 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:43.160+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:06:43.562 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:43.564+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:06:43.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:43.564+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:06:44.366 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:44.368+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:06:44.367 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:44.368+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:06:45.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:45.972+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:06:46.077 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:45.972+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:06:47.395 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:06:47.396+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:06:47.396 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:47.396+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:06:47.396 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:47.396+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:06:47.396 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:47.396+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1116 cs=1 l=1).handle_message read tag failed 2021-03-09T09:06:47.396 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:47.396+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1116 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:06:49.174 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:49.176+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:06:49.175 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:49.176+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:06:52.395 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:06:52.396+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:06:55.581 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:55.580+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:06:55.581 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:06:55.580+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:06:57.395 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:06:57.396+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:07:02.396 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:07:02.395+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:07:07.396 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:07:07.395+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:07:08.388 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:08.387+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:07:08.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:08.391+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:07:12.396 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:07:12.395+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:07:12.955 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:12.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:07:12.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:12.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:07:12.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:12.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:07:12.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:12.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003920 con 0x7fdd20005050 2021-03-09T09:07:12.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:12.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003390 2021-03-09T09:07:12.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:12.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20006b10 2021-03-09T09:07:12.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:12.955+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:07:12.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:12.955+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:07:13.158 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:13.159+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:07:13.159 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:13.159+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:07:13.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:13.563+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:07:13.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:13.563+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:07:14.366 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:14.367+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:07:14.367 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:14.367+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:07:15.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:15.971+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:07:15.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:15.971+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:07:17.396 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:07:17.395+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:07:17.397 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:17.395+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:07:17.397 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:17.395+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:07:17.397 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:17.395+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1133 cs=1 l=1).handle_message read tag failed 2021-03-09T09:07:17.398 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:17.395+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1133 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:07:19.175 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:19.175+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:07:19.175 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:19.175+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:07:22.397 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:07:22.395+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:07:25.581 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:25.579+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:07:25.581 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:25.579+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:07:27.397 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:07:27.395+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:07:32.397 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:07:32.395+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:07:37.397 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:07:37.399+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:07:38.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:38.391+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:07:38.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:38.395+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:07:42.397 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:07:42.395+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:07:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:42.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:07:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:42.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:07:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:42.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:07:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:42.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20005050 2021-03-09T09:07:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:42.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003920 con 0x7fdd20003390 2021-03-09T09:07:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:42.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:07:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:42.955+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:07:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:42.955+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:07:43.158 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:43.159+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:07:43.159 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:43.159+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:07:43.562 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:43.563+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:07:43.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:43.563+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:07:44.366 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:44.367+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:07:44.367 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:44.367+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:07:45.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:45.970+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:07:45.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:45.970+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:07:47.397 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:07:47.394+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:07:47.398 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:47.394+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:07:47.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:47.394+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:07:47.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:47.394+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1150 cs=1 l=1).handle_message read tag failed 2021-03-09T09:07:47.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:47.394+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1150 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:07:49.174 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:49.174+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:07:49.175 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:49.174+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:07:52.398 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:07:52.398+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:07:55.581 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:55.582+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:07:55.581 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:07:55.582+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:07:57.398 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:07:57.398+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:08:02.398 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:08:02.398+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:08:07.398 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:08:07.398+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:08:08.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:08.390+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:08:08.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:08.394+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:08:12.399 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:08:12.398+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:08:12.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:12.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:08:12.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:12.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:08:12.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:12.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:08:12.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:12.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20005050 2021-03-09T09:08:12.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:12.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003390 2021-03-09T09:08:12.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:12.954+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003920 con 0x7fdd20006b10 2021-03-09T09:08:12.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:12.954+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:08:12.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:12.954+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:08:13.156 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:13.158+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:08:13.157 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:13.158+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:08:13.562 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:13.562+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:08:13.562 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:13.562+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:08:14.366 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:14.366+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:08:14.366 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:14.366+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:08:15.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:15.970+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:08:15.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:15.970+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:08:17.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:17.398+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:08:17.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:17.398+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:08:17.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:17.398+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1167 cs=1 l=1).handle_message read tag failed 2021-03-09T09:08:17.400 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:17.398+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1167 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:08:17.400 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:08:17.398+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:08:19.174 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:19.174+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:08:19.175 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:19.174+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:08:22.399 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:08:22.398+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:08:25.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:25.578+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:08:25.580 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:25.578+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:08:27.399 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:08:27.398+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:08:32.400 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:08:32.401+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:08:37.400 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:08:37.401+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:08:38.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:38.389+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:08:38.393 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:38.389+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:08:42.400 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:08:42.401+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:08:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:42.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:08:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:42.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:08:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:42.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:08:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:42.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20005050 2021-03-09T09:08:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:42.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003390 2021-03-09T09:08:42.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:42.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:08:42.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:42.953+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:08:42.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:42.953+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:08:43.157 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:43.157+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:08:43.157 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:43.157+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:08:43.562 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:43.561+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:08:43.562 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:43.561+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:08:44.366 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:44.365+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:08:44.366 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:44.365+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:08:45.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:45.969+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:08:45.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:45.969+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:08:47.400 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:08:47.397+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:08:47.401 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:47.397+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:08:47.401 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:47.397+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:08:47.401 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:47.397+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1184 cs=1 l=1).handle_message read tag failed 2021-03-09T09:08:47.401 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:47.397+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1184 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:08:49.172 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:49.173+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:08:49.172 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:49.173+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:08:52.400 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:08:52.397+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:08:55.579 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:55.577+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:08:55.579 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:08:55.577+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:08:57.401 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:08:57.401+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:09:02.401 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:09:02.401+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:09:07.401 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:09:07.401+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:09:08.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:08.385+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:09:08.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:08.385+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:09:12.401 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:09:12.400+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:09:12.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:12.952+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:09:12.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:12.952+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:09:12.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:12.952+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:09:12.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:12.952+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20005050 2021-03-09T09:09:12.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:12.952+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003390 2021-03-09T09:09:12.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:12.952+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:09:12.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:12.952+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:09:12.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:12.952+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:09:13.157 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:13.156+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:09:13.157 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:13.156+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:09:13.562 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:13.560+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:09:13.562 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:13.560+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:09:14.366 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:14.364+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:09:14.366 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:14.364+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:09:15.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:15.968+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:09:15.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:15.968+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:09:17.402 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:09:17.396+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:09:17.402 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:17.396+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:09:17.403 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:17.396+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:09:17.403 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:17.396+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1201 cs=1 l=1).handle_message read tag failed 2021-03-09T09:09:17.403 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:17.396+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1201 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:09:19.173 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:19.172+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:09:19.173 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:19.172+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:09:22.402 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:09:22.400+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:09:25.580 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:25.580+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:09:25.580 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:25.580+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:09:27.402 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:09:27.400+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:09:32.402 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:09:32.404+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:09:37.402 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:09:37.404+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:09:38.384 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:38.384+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:09:38.384 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:38.384+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:09:42.402 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:09:42.404+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:09:42.956 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:09:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:09:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:09:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20005050 2021-03-09T09:09:42.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20003390 2021-03-09T09:09:42.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:09:42.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:42.956+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:09:42.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:42.956+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:09:43.158 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:43.160+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:09:43.158 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:43.160+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:09:43.562 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:43.564+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:09:43.562 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:43.564+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:09:44.366 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:44.368+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:09:44.366 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:44.368+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:09:45.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:45.972+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:09:45.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:45.972+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:09:47.402 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:09:47.404+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:09:47.403 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:47.404+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:09:47.403 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:47.404+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:09:47.404 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:47.404+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1218 cs=1 l=1).handle_message read tag failed 2021-03-09T09:09:47.404 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:47.404+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1218 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:09:49.174 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:49.176+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:09:49.174 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:49.176+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:09:52.403 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:09:52.404+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:09:55.580 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:55.580+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:09:55.581 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:09:55.580+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:09:57.403 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:09:57.403+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:10:02.403 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:10:02.403+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:10:07.404 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:10:07.403+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:10:08.393 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:08.391+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:10:08.393 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:08.395+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:10:12.403 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:10:12.403+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:10:12.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:12.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:10:12.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:12.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:10:12.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:12.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:10:12.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:12.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20005050 2021-03-09T09:10:12.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:12.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003390 2021-03-09T09:10:12.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:12.955+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20006b10 2021-03-09T09:10:12.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:12.955+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:10:12.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:12.955+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:10:13.157 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:13.159+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:10:13.158 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:13.159+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:10:13.561 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:13.563+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:10:13.562 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:13.563+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:10:14.366 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:14.367+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:10:14.366 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:14.367+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:10:15.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:15.971+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:10:15.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:15.971+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:10:17.404 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:10:17.403+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:10:17.404 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:17.403+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:10:17.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:17.403+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:10:17.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:17.403+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1235 cs=1 l=1).handle_message read tag failed 2021-03-09T09:10:17.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:17.403+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1235 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:10:19.174 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:19.175+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:10:19.175 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:19.175+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:10:22.404 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:10:22.403+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:10:25.580 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:25.579+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:10:25.580 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:25.579+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:10:27.404 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:10:27.407+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:10:32.404 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:10:32.403+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:10:37.405 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:10:37.407+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:10:38.393 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:38.395+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:10:38.393 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:38.395+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:10:39.091 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:39.091+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd44064d50 legacy=0x7fdd24065a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-03-09T09:10:39.091 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:39.091+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd44064d50 legacy=0x7fdd24065a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:10:39.092 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:39.091+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd44064d50 0x7fdd24065a80 :-1 s=OPENED pgs=43 cs=1 l=1).handle_message read tag failed 2021-03-09T09:10:39.092 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:39.091+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd44064d50 0x7fdd24065a80 :-1 s=OPENED pgs=43 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:10:39.093 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:39.091+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd44064d50 legacy=0x7fdd24065a80 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting, fault. 2021-03-09T09:10:39.093 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:39.091+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd44064d50 legacy=0x7fdd24065a80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:10:42.405 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:10:42.406+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:10:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:42.958+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:10:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:42.958+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:10:42.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:42.958+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:10:42.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:42.958+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:10:42.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:42.958+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003390 2021-03-09T09:10:42.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:42.958+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:10:42.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:42.958+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:10:42.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:42.958+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:10:43.161 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:43.162+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:10:43.162 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:43.162+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:10:43.565 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:43.566+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:10:43.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:43.566+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:10:44.369 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:44.370+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:10:44.370 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:44.370+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:10:45.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:45.974+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:10:45.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:45.974+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:10:47.405 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:10:47.406+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:10:47.406 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:47.406+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:10:47.407 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:47.406+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:10:47.407 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:47.406+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1252 cs=1 l=1).handle_message read tag failed 2021-03-09T09:10:47.407 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:47.406+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1252 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:10:49.176 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:49.178+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:10:49.177 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:49.178+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:10:52.406 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:10:52.406+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:10:55.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:55.582+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:10:55.584 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:10:55.582+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:10:57.406 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:10:57.406+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:11:02.406 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:11:02.406+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:11:07.406 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:11:07.406+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:11:08.395 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:08.398+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:11:08.397 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:08.398+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:11:12.407 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:11:12.405+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:11:12.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:12.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:11:12.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:12.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:11:12.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:12.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:11:12.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:12.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003810 con 0x7fdd20003eb0 2021-03-09T09:11:12.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:12.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20005050 2021-03-09T09:11:12.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:12.953+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:11:12.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:12.957+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:11:12.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:12.957+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:11:13.162 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:13.161+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:11:13.310 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:13.161+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:11:13.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:13.565+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:11:13.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:13.565+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:11:14.370 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:14.369+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:11:14.370 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:14.369+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:11:15.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:15.973+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:11:15.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:15.973+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:11:17.407 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:11:17.405+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:11:17.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:17.405+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:11:17.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:17.405+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:11:17.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:17.405+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1269 cs=1 l=1).handle_message read tag failed 2021-03-09T09:11:17.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:17.405+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1269 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:11:19.177 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:19.177+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:11:19.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:19.177+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:11:22.407 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:11:22.409+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:11:25.584 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:25.585+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:11:25.585 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:25.585+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:11:27.407 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:11:27.405+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:11:32.408 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:11:32.405+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:11:37.408 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:11:37.409+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:11:38.398 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:38.397+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:11:38.398 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:38.397+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:11:42.408 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:11:42.408+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:11:42.958 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:11:42.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:11:42.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:11:42.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20019680 2021-03-09T09:11:42.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003810 con 0x7fdd20003390 2021-03-09T09:11:42.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:42.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:11:42.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:42.956+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:11:42.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:42.956+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:11:43.162 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:43.160+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:11:43.162 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:43.160+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:11:43.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:43.564+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:11:43.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:43.564+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:11:44.370 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:44.368+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:11:44.371 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:44.368+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:11:45.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:45.972+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:11:45.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:45.972+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:11:47.408 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:11:47.408+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:11:47.409 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:47.408+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:11:47.409 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:47.408+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:11:47.410 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:47.408+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1286 cs=1 l=1).handle_message read tag failed 2021-03-09T09:11:47.410 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:47.408+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1286 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:11:49.175 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:49.176+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:11:49.175 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:49.176+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:11:52.409 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:11:52.408+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:11:55.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:55.580+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:11:55.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:11:55.580+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:11:57.409 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:11:57.408+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:12:02.409 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:12:02.408+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:12:07.409 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:12:07.408+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:12:08.395 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:08.396+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:12:08.395 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:08.396+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:12:12.409 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:12:12.408+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:12:12.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:12.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:12:12.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:12.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:12:12.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:12.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:12:12.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:12.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20005050 2021-03-09T09:12:12.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:12.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003390 2021-03-09T09:12:12.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:12.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003810 con 0x7fdd20006b10 2021-03-09T09:12:12.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:12.960+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:12:12.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:12.960+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:12:13.162 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:13.164+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:12:13.162 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:13.164+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:12:13.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:13.568+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:12:13.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:13.568+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:12:14.370 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:14.372+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:12:14.371 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:14.372+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:12:15.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:15.976+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:12:15.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:15.976+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:12:17.410 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:17.411+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:12:17.411 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:17.411+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:12:17.411 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:17.411+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1303 cs=1 l=1).handle_message read tag failed 2021-03-09T09:12:17.411 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:17.411+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1303 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:12:17.411 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:12:17.411+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:12:19.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:19.179+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:12:19.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:19.179+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:12:22.410 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:12:22.411+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:12:25.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:25.583+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:12:25.583 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:25.583+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:12:27.410 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:12:27.411+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:12:32.411 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:12:32.411+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:12:37.411 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:12:37.411+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:12:38.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:38.387+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:12:38.387 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:38.387+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:12:42.411 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:12:42.411+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:12:42.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:42.959+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:12:42.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:42.959+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:12:42.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:42.959+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:12:42.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:42.959+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:12:42.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:42.959+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20019680 2021-03-09T09:12:42.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:42.959+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:12:42.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:42.959+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:12:42.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:42.959+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:12:43.162 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:43.163+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:12:43.162 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:43.163+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:12:43.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:43.567+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:12:43.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:43.567+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:12:44.372 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:44.371+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:12:44.373 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:44.371+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:12:45.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:45.975+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:12:45.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:45.975+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:12:47.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:47.411+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:12:47.413 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:47.411+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:12:47.413 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:47.411+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1324 cs=1 l=1).handle_message read tag failed 2021-03-09T09:12:47.414 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:12:47.411+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:12:47.415 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:47.411+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1324 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:12:49.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:49.179+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:12:49.179 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:49.179+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:12:52.412 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:12:52.410+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:12:55.585 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:55.586+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:12:55.585 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:12:55.586+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:12:57.412 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:12:57.410+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:13:02.412 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:13:02.414+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:13:07.413 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:13:07.414+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:13:08.398 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:08.398+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:13:08.398 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:08.398+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:13:12.413 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:13:12.414+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:13:12.959 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:12.958+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:13:12.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:12.958+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019680 legacy=0x7fdd2001ba70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:13:12.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:12.958+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:13:12.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:12.958+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003810 con 0x7fdd20003eb0 2021-03-09T09:13:12.960 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:12.958+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003390 2021-03-09T09:13:12.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:12.958+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:13:12.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:12.958+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:13:12.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:12.958+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:13:13.162 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:13.162+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:13:13.162 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:13.162+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:13:13.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:13.566+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:13:13.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:13.566+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:13:14.370 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:14.370+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:13:14.370 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:14.370+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:13:15.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:15.974+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:13:15.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:15.974+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:13:17.413 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:13:17.414+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:13:17.414 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:17.414+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:13:17.414 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:17.414+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:13:17.415 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:17.414+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1361 cs=1 l=1).handle_message read tag failed 2021-03-09T09:13:17.415 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:17.414+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1361 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:13:19.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:19.178+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:13:19.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:19.178+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:13:22.414 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:13:22.414+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:13:25.585 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:25.582+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:13:25.585 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:25.582+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:13:27.414 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:13:27.413+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:13:32.414 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:13:32.413+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:13:37.415 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:13:37.413+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:13:38.398 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:38.397+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:13:38.398 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:38.397+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:13:42.415 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:13:42.413+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:13:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:42.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:13:43.755 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:42.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:13:43.755 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:42.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:13:43.755 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:42.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20005050 2021-03-09T09:13:43.756 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:42.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003810 con 0x7fdd20003390 2021-03-09T09:13:43.756 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:42.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:13:43.756 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:42.961+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:13:43.756 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:42.961+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:13:43.757 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:43.165+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:13:43.758 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:43.165+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:13:43.758 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:43.569+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:13:43.758 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:43.569+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:13:44.372 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:44.373+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:13:44.373 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:44.373+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:13:45.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:45.977+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:13:45.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:45.977+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:13:47.415 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:47.413+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:13:47.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:47.413+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:13:47.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:47.413+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1397 cs=1 l=1).handle_message read tag failed 2021-03-09T09:13:47.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:47.413+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1397 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:13:47.417 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:13:47.413+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:13:49.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:49.181+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:13:49.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:49.181+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:13:52.415 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:13:52.413+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:13:55.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:55.589+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:13:55.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:13:55.589+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:13:57.416 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:13:57.413+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:14:02.416 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:14:02.412+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:14:07.416 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:14:07.416+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:14:08.395 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:08.396+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:14:08.396 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:08.396+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:14:12.416 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:14:12.412+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:14:12.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:12.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:14:12.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:12.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:14:12.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:12.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:14:12.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:12.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20005050 2021-03-09T09:14:12.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:12.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003390 2021-03-09T09:14:12.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:12.956+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003810 con 0x7fdd20006b10 2021-03-09T09:14:12.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:12.956+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:14:12.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:12.956+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:14:13.161 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:13.160+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:14:13.161 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:13.160+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:14:13.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:13.564+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:14:13.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:13.564+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:14:14.367 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:14.368+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:14:14.367 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:14.368+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:14:15.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:15.972+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:14:15.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:15.972+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:14:17.417 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:14:17.416+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:14:17.418 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:17.416+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:14:17.418 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:17.416+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:14:17.418 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:17.416+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1430 cs=1 l=1).handle_message read tag failed 2021-03-09T09:14:17.418 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:17.416+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1430 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:14:19.175 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:19.176+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:14:19.176 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:19.176+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:14:22.417 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:14:22.416+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:14:25.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:25.580+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:14:25.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:25.584+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:14:27.417 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:14:27.416+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:14:32.418 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:14:32.416+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:14:37.418 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:14:37.416+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:14:38.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:38.395+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:14:38.395 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:38.395+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:14:42.418 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:14:42.415+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:14:42.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:42.959+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:14:42.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:42.959+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:14:42.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:42.959+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:14:42.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:42.959+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:14:42.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:42.959+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003390 2021-03-09T09:14:42.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:42.959+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:14:42.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:42.959+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:14:42.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:42.959+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:14:43.162 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:43.163+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:14:43.162 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:43.163+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:14:43.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:43.567+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:14:43.567 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:43.567+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:14:44.370 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:44.371+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:14:44.370 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:44.371+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:14:45.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:45.975+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:14:45.975 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:45.975+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:14:47.418 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:14:47.419+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:14:47.419 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:47.419+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:14:47.419 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:47.419+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:14:47.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:47.419+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1447 cs=1 l=1).handle_message read tag failed 2021-03-09T09:14:47.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:47.419+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1447 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:14:49.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:49.179+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:14:49.179 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:49.179+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:14:52.419 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:14:52.419+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:14:55.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:55.583+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:14:55.585 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:14:55.583+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:14:57.419 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:14:57.419+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:15:02.419 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:15:02.419+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:15:07.419 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:15:07.419+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:15:08.389 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:08.391+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:15:08.398 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:08.399+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:15:12.419 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:15:12.419+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:15:12.961 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:15:12.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:15:12.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:15:12.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20003eb0 2021-03-09T09:15:12.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003390 2021-03-09T09:15:12.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:15:12.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:12.963+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:15:12.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:12.963+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:15:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:13.167+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:15:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:13.167+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:15:13.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:13.571+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:15:13.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:13.571+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:15:14.374 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:14.374+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:15:14.374 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:14.374+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:15:15.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:15.978+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:15:15.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:15.978+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:15:17.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:17.418+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:15:17.421 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:17.418+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:15:17.421 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:17.418+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1464 cs=1 l=1).handle_message read tag failed 2021-03-09T09:15:17.421 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:17.418+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1464 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:15:17.422 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:15:17.418+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:15:19.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:19.182+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:15:19.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:19.182+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:15:22.420 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:15:22.418+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:15:25.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:25.590+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:15:25.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:25.590+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:15:27.420 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:15:27.422+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:15:32.424 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:15:32.422+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:15:37.421 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:15:37.422+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:15:38.402 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:38.398+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:15:38.403 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:38.402+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:15:42.421 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:15:42.422+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:15:42.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:42.962+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:15:42.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:42.962+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:15:42.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:42.962+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:15:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:42.962+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003eb0 2021-03-09T09:15:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:42.962+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20005050 2021-03-09T09:15:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:42.962+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:15:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:42.962+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:15:42.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:42.962+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:15:43.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:43.166+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:15:43.167 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:43.166+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:15:43.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:43.570+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:15:43.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:43.570+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:15:44.374 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:44.374+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:15:44.375 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:44.374+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:15:45.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:45.978+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:15:45.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:45.978+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:15:47.421 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:15:47.422+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:15:47.422 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:47.422+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:15:47.422 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:47.422+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:15:47.422 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:47.422+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1481 cs=1 l=1).handle_message read tag failed 2021-03-09T09:15:47.423 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:47.422+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1481 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:15:49.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:49.182+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:15:49.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:49.182+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:15:52.421 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:15:52.417+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:15:55.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:55.589+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:15:55.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:15:55.589+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:15:57.422 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:15:57.417+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:16:02.422 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:16:02.421+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:16:07.422 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:16:07.421+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:16:08.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:08.393+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:16:08.395 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:08.393+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:16:12.422 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:16:12.421+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:16:12.962 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:12.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:16:12.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:12.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:16:12.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:12.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:16:12.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:12.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:16:12.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:12.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003390 2021-03-09T09:16:12.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:12.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20006b10 2021-03-09T09:16:12.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:12.961+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:16:12.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:12.961+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:16:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:13.165+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:16:13.167 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:13.165+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:16:13.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:13.569+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:16:13.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:13.569+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:16:14.374 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:14.373+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:16:14.375 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:14.373+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:16:15.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:15.977+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:16:15.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:15.977+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:16:17.423 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:17.421+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:16:17.423 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:17.421+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:16:17.423 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:16:17.421+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:16:17.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:17.421+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1498 cs=1 l=1).handle_message read tag failed 2021-03-09T09:16:17.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:17.421+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1498 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:16:19.180 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:19.181+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:16:19.180 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:19.181+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:16:22.423 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:16:22.421+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:16:25.587 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:25.585+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:16:25.587 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:25.585+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:16:27.423 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:16:27.425+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:16:32.423 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:16:32.420+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:16:37.423 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:16:37.424+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:16:38.400 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:38.400+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:16:38.400 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:38.400+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:16:42.423 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:16:42.420+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:16:42.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:42.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:16:42.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:42.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:16:42.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:42.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:16:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:42.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:16:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:42.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20005050 2021-03-09T09:16:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:42.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:16:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:42.960+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:16:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:42.960+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:16:43.163 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:43.164+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:16:43.163 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:43.164+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:16:43.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:43.568+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:16:43.571 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:43.568+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:16:44.371 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:44.372+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:16:44.371 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:44.372+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:16:45.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:45.976+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:16:45.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:45.976+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:16:47.424 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:16:47.424+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:16:47.425 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:47.424+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:16:47.425 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:47.424+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:16:47.426 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:47.424+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1515 cs=1 l=1).handle_message read tag failed 2021-03-09T09:16:47.426 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:47.424+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1515 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:16:49.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:49.180+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:16:49.181 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:49.180+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:16:52.424 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:16:52.424+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:16:55.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:55.584+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:16:55.588 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:16:55.588+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:16:57.424 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:16:57.424+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:17:02.424 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:17:02.424+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:17:07.425 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:17:07.423+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:17:08.395 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:08.395+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:17:08.401 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:08.399+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:17:12.425 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:17:12.423+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:17:12.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:17:12.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20005050 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:17:12.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:17:12.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003390 con 0x7fdd20003eb0 2021-03-09T09:17:12.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000f640 2021-03-09T09:17:12.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:17:12.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:12.963+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:17:12.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:12.963+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:17:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:13.167+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:17:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:13.167+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:17:13.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:13.571+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:17:13.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:13.571+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:17:14.374 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:14.375+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:17:14.375 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:14.375+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:17:15.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:15.979+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:17:15.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:15.979+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:17:17.425 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:17:17.423+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:17:17.426 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:17.423+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:17:17.426 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:17.423+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:17:17.426 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:17.423+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1532 cs=1 l=1).handle_message read tag failed 2021-03-09T09:17:17.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:17.423+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1532 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:17:19.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:19.183+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:17:19.183 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:19.183+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:17:22.426 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:17:22.423+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:17:25.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:25.587+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:17:25.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:25.587+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:17:27.426 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:17:27.423+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:17:32.426 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:17:32.427+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:17:37.426 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:17:37.427+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:17:38.402 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:38.403+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:17:38.402 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:38.403+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:17:42.427 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:17:42.427+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:17:42.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:42.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:17:42.963 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:42.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:17:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:42.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:17:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:42.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003eb0 2021-03-09T09:17:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:42.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003390 con 0x7fdd2000f640 2021-03-09T09:17:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:42.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:17:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:42.963+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:17:42.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:42.963+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:17:43.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:43.167+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:17:43.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:43.167+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:17:43.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:43.570+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:17:43.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:43.570+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:17:44.374 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:44.374+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:17:44.374 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:44.374+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:17:45.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:45.978+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:17:45.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:45.978+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:17:47.427 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:17:47.426+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:17:47.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:47.426+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:17:47.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:47.426+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:17:47.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:47.426+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1549 cs=1 l=1).handle_message read tag failed 2021-03-09T09:17:47.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:47.426+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1549 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:17:49.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:49.182+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:17:49.183 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:49.182+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:17:52.427 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:17:52.426+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:17:55.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:55.590+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:17:55.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:17:55.590+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:17:57.427 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:17:57.426+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:18:02.427 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:18:02.426+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:18:07.428 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:18:07.426+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:18:08.398 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:08.394+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:18:08.402 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:08.402+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:18:12.427 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:18:12.426+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:18:12.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:12.962+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:18:12.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:12.962+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:18:12.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:12.962+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:18:12.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:12.962+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20005050 2021-03-09T09:18:12.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:12.962+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd2000f640 2021-03-09T09:18:12.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:12.962+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003390 con 0x7fdd20006b10 2021-03-09T09:18:12.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:12.962+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:18:12.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:12.962+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:18:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:13.166+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:18:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:13.166+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:18:13.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:13.570+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:18:13.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:13.570+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:18:14.374 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:14.374+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:18:14.374 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:14.374+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:18:15.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:15.978+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:18:15.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:15.978+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:18:17.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:17.426+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:18:17.429 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:17.426+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:18:17.429 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:18:17.426+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:18:17.430 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:17.426+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1566 cs=1 l=1).handle_message read tag failed 2021-03-09T09:18:17.430 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:17.426+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1566 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:18:19.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:19.182+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:18:19.183 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:19.182+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:18:22.428 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:18:22.429+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:18:25.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:25.589+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:18:25.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:25.589+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:18:27.429 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:18:27.425+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:18:32.429 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:18:32.425+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:18:37.429 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:18:37.429+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:18:38.402 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:38.401+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:18:38.403 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:38.401+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:18:42.429 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:18:42.429+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:18:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:42.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:18:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:42.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:18:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:42.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:18:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:42.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:18:42.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:42.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd2000f640 2021-03-09T09:18:42.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:42.961+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:18:42.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:42.961+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:18:42.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:42.961+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:18:43.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:43.165+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:18:43.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:43.165+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:18:43.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:43.569+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:18:43.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:43.569+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:18:44.371 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:44.373+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:18:44.372 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:44.373+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:18:45.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:45.977+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:18:45.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:45.977+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:18:47.429 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:47.425+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:18:47.430 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:47.425+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:18:47.430 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:47.425+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1583 cs=1 l=1).handle_message read tag failed 2021-03-09T09:18:47.430 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:47.425+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1583 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:18:47.431 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:18:47.425+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:18:49.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:49.181+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:18:49.183 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:49.181+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:18:52.430 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:18:52.429+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:18:55.588 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:55.585+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:18:55.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:18:55.589+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:18:57.430 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:18:57.429+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:19:02.430 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:19:02.428+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:19:07.430 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:19:07.428+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:19:08.402 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:08.400+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:19:08.403 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:08.400+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:19:12.431 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:19:12.432+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:19:12.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:12.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:19:12.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:12.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:19:12.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:12.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:19:12.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:12.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003390 con 0x7fdd20003eb0 2021-03-09T09:19:12.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:12.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000f640 2021-03-09T09:19:12.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:12.960+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:19:12.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:12.960+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:19:12.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:12.960+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:19:13.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:13.164+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:19:13.167 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:13.164+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:19:13.567 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:13.568+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:19:13.568 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:13.568+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:19:14.372 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:14.372+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:19:14.372 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:14.372+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:19:15.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:15.976+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:19:15.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:15.976+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:19:17.431 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:19:17.432+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:19:17.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:17.432+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:19:17.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:17.432+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:19:17.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:17.432+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1600 cs=1 l=1).handle_message read tag failed 2021-03-09T09:19:17.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:17.432+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1600 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:19:19.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:19.180+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:19:19.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:19.180+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:19:22.431 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:19:22.432+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:19:25.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:25.588+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:19:25.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:25.588+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:19:27.431 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:19:27.432+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:19:32.432 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:19:32.432+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:19:37.432 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:19:37.432+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:19:38.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:38.396+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:19:38.395 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:38.396+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:19:42.432 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:19:42.431+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:19:42.964 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:42.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:19:42.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:42.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:19:42.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:42.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:19:42.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:42.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003eb0 2021-03-09T09:19:42.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:42.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003390 con 0x7fdd2000f640 2021-03-09T09:19:42.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:42.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:19:42.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:42.963+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:19:42.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:42.963+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:19:43.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:43.167+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:19:43.166 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:43.167+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:19:43.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:43.571+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:19:43.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:43.571+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:19:44.374 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:44.375+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:19:44.374 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:44.375+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:19:45.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:45.979+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:19:45.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:45.979+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:19:47.432 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:19:47.431+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:19:47.433 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:47.431+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:19:47.433 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:47.431+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:19:47.434 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:47.431+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1617 cs=1 l=1).handle_message read tag failed 2021-03-09T09:19:47.434 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:47.431+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1617 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:19:49.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:49.183+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:19:49.183 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:49.183+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:19:52.433 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:19:52.431+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:19:55.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:55.587+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:19:55.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:19:55.587+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:19:57.433 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:19:57.431+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:20:02.433 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:20:02.435+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:20:07.433 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:20:07.435+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:20:08.402 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:08.403+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:20:08.402 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:08.403+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:20:12.434 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:20:12.435+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:20:12.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:20:12.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:20:12.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:20:12.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:20:12.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd2000f640 2021-03-09T09:20:12.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:12.963+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003390 con 0x7fdd20006b10 2021-03-09T09:20:12.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:12.963+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:20:12.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:12.963+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:20:13.165 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:13.167+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:20:13.165 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:13.167+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:20:13.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:13.571+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:20:13.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:13.571+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:20:14.374 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:14.375+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:20:14.374 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:14.375+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:20:15.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:15.979+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:20:15.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:15.979+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:20:17.434 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:17.435+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:20:17.434 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:17.435+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:20:17.435 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:20:17.435+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:20:17.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:17.435+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1634 cs=1 l=1).handle_message read tag failed 2021-03-09T09:20:17.436 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:17.435+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1634 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:20:19.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:19.182+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:20:19.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:19.182+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:20:22.434 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:20:22.434+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:20:25.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:25.586+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:20:25.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:25.586+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:20:27.434 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:20:27.434+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:20:32.435 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:20:32.434+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:20:37.435 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:20:37.434+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:20:38.392 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:38.390+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:20:38.401 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:38.398+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:20:42.435 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:20:42.434+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:20:42.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:42.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:20:42.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:42.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:20:42.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:42.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:20:42.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:42.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:20:42.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:42.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd2000f640 2021-03-09T09:20:42.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:42.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:20:42.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:42.966+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:20:42.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:42.966+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:20:43.170 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:43.170+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:20:43.170 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:43.170+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:20:43.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:43.574+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:20:43.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:43.574+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:20:44.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:44.378+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:20:44.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:44.378+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:20:45.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:45.982+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:20:45.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:45.982+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:20:47.435 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:20:47.434+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:20:47.436 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:47.434+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:20:47.436 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:47.434+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:20:47.437 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:47.434+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1651 cs=1 l=1).handle_message read tag failed 2021-03-09T09:20:47.437 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:47.434+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1651 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:20:49.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:49.186+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:20:49.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:49.186+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:20:52.435 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:20:52.434+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:20:55.592 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:55.594+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:20:55.593 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:20:55.594+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:20:57.435 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:20:57.437+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:21:02.436 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:21:02.433+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:21:07.436 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:21:07.437+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:21:08.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:08.405+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:21:08.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:08.405+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:21:12.436 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:21:12.437+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:21:12.965 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:12.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:21:12.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:12.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:21:12.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:12.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:21:12.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:12.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003390 con 0x7fdd20003eb0 2021-03-09T09:21:12.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:12.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000f640 2021-03-09T09:21:12.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:12.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:21:12.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:12.965+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:21:12.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:12.965+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:21:13.170 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:13.169+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:21:13.170 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:13.169+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:21:13.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:13.573+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:21:13.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:13.573+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:21:14.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:14.377+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:21:14.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:14.377+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:21:15.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:15.981+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:21:15.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:15.981+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:21:17.436 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:21:17.437+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:21:17.437 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:17.437+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:21:17.437 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:17.437+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:21:17.438 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:17.437+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1668 cs=1 l=1).handle_message read tag failed 2021-03-09T09:21:17.438 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:17.437+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1668 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:21:19.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:19.185+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:21:19.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:19.185+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:21:22.437 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:21:22.433+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:21:25.593 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:25.593+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:21:25.593 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:25.593+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:21:27.437 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:21:27.433+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:21:32.437 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:21:32.437+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:21:37.437 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:21:37.436+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:21:38.402 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:38.400+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:21:38.406 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:38.404+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:21:42.437 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:21:42.432+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:21:42.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:42.964+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:21:42.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:42.964+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:21:42.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:42.964+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:21:42.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:42.964+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003eb0 2021-03-09T09:21:42.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:42.964+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003390 con 0x7fdd2000f640 2021-03-09T09:21:42.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:42.964+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:21:42.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:42.964+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:21:42.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:42.964+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:21:43.170 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:43.168+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:21:43.170 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:43.168+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:21:43.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:43.572+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:21:43.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:43.572+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:21:44.375 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:44.376+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:21:44.375 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:44.376+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:21:45.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:45.980+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:21:45.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:45.980+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:21:47.438 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:21:47.436+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:21:47.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:47.436+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:21:47.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:47.436+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:21:47.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:47.436+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1685 cs=1 l=1).handle_message read tag failed 2021-03-09T09:21:47.440 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:47.436+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1685 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:21:49.185 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:49.184+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:21:49.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:49.184+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:21:52.438 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:21:52.440+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:21:55.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:55.588+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:21:55.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:21:55.588+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:21:57.438 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:21:57.440+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:22:02.439 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:22:02.440+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:22:07.439 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:22:07.440+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:22:08.406 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:08.408+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:22:08.406 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:08.408+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:22:12.439 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:22:12.440+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:22:12.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:12.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:22:12.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:12.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:22:12.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:12.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:22:12.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:12.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:22:12.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:12.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd2000f640 2021-03-09T09:22:12.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:12.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003390 con 0x7fdd20006b10 2021-03-09T09:22:12.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:12.968+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:22:12.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:12.968+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:22:13.170 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:13.172+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:22:13.170 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:13.172+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:22:13.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:13.576+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:22:13.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:13.576+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:22:14.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:14.380+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:22:14.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:14.380+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:22:15.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:15.984+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:22:15.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:15.984+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:22:17.439 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:22:17.439+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:22:17.440 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:17.439+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:22:17.440 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:17.439+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:22:17.440 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:17.439+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1702 cs=1 l=1).handle_message read tag failed 2021-03-09T09:22:17.441 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:17.439+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1702 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:22:19.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:19.187+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:22:19.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:19.187+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:22:22.439 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:22:22.439+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:22:25.592 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:25.591+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:22:25.593 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:25.591+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:22:27.439 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:22:27.439+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:22:32.440 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:22:32.439+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:22:37.440 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:22:37.439+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:22:38.397 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:38.399+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:22:38.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:38.407+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:22:42.440 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:22:42.439+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:22:42.966 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:42.967+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:22:42.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:42.967+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:22:42.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:42.967+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:22:42.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:42.967+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:22:42.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:42.967+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd2000f640 2021-03-09T09:22:42.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:42.967+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:22:42.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:42.967+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:22:42.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:42.967+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:22:43.170 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:43.171+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:22:43.170 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:43.171+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:22:43.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:43.575+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:22:43.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:43.575+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:22:44.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:44.379+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:22:44.379 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:44.379+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:22:45.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:45.983+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:22:45.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:45.983+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:22:47.440 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:22:47.439+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:22:47.441 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:47.439+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:22:47.442 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:47.439+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:22:47.442 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:47.439+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1719 cs=1 l=1).handle_message read tag failed 2021-03-09T09:22:47.442 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:47.439+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=1719 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:22:49.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:49.187+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:22:49.187 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:49.187+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:22:52.441 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:22:52.439+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:22:55.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:55.591+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:22:55.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:22:55.591+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:22:57.441 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:22:57.438+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:23:02.441 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:23:02.442+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:23:07.441 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:23:07.442+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:23:08.402 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:08.402+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:23:08.403 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:08.402+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:23:12.441 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:23:12.438+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:23:12.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:12.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:23:12.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:12.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f640 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:23:12.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:12.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:23:12.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:12.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T09:23:12.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:12.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003390 2021-03-09T09:23:12.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:12.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:23:12.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:12.966+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:23:12.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:12.966+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:23:13.170 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:13.170+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:23:13.170 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:13.170+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:23:13.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:13.574+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:23:13.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:13.574+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:23:14.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:14.378+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:23:14.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:14.378+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:23:15.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:15.982+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:23:15.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:15.982+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:23:17.442 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:23:17.442+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:23:17.442 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:17.442+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:23:17.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:17.442+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:23:17.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:17.442+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1736 cs=1 l=1).handle_message read tag failed 2021-03-09T09:23:17.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:17.442+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1736 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:23:19.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:19.186+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:23:19.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:19.186+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:23:22.442 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:23:22.442+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:23:25.588 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:25.590+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:23:25.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:25.590+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:23:27.442 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:23:27.442+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:23:32.442 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:23:32.442+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:23:37.443 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:23:37.441+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:23:38.401 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:38.401+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:23:38.402 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:38.401+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:23:42.442 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:23:42.441+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:23:42.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:42.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:23:42.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:42.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:23:42.967 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:42.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:23:42.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:42.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003790 con 0x7fdd20003eb0 2021-03-09T09:23:42.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:42.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003390 2021-03-09T09:23:42.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:42.965+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:23:42.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:42.965+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:23:42.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:42.965+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:23:43.167 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:43.169+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:23:43.168 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:43.169+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:23:43.573 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:43.573+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:23:43.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:43.573+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:23:44.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:44.377+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:23:44.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:44.377+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:23:45.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:45.981+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:23:45.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:45.981+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:23:47.443 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:23:47.441+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:23:47.444 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:47.441+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:23:47.444 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:47.441+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:23:47.444 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:47.441+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1753 cs=1 l=1).handle_message read tag failed 2021-03-09T09:23:47.445 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:47.441+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1753 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:23:49.185 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:49.185+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:23:49.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:49.185+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:23:52.443 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:23:52.441+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:23:55.592 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:55.593+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:23:55.592 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:23:55.593+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:23:57.444 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:23:57.441+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:24:02.444 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:24:02.441+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:24:07.444 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:24:07.445+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:24:08.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:08.401+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:24:08.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:08.401+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:24:12.444 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:24:12.445+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:24:12.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:12.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:24:12.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:12.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:24:12.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:12.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:24:12.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:12.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd2000daa0 2021-03-09T09:24:12.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:12.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003790 con 0x7fdd20003390 2021-03-09T09:24:12.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:12.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T09:24:12.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:12.969+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:24:12.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:12.969+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:24:13.172 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:13.173+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:24:13.172 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:13.173+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:24:13.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:13.577+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:24:13.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:13.577+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:24:14.379 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:14.381+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:24:14.380 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:14.381+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:24:15.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:15.985+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:24:15.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:15.985+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:24:17.445 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:17.441+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:24:17.446 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:17.441+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:24:17.446 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:17.441+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1774 cs=1 l=1).handle_message read tag failed 2021-03-09T09:24:17.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:17.441+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1774 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:24:17.447 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:24:17.441+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:24:19.189 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:19.188+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:24:19.190 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:19.188+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:24:22.446 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:24:22.444+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:24:25.596 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:25.596+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:24:25.597 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:25.596+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:24:27.446 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:24:27.444+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:24:32.446 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:24:32.448+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:24:37.446 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:24:37.448+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:24:38.406 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:38.408+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:24:38.406 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:38.408+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:24:42.446 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:24:42.448+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:24:42.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:42.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:24:42.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:42.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:24:42.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:42.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:24:42.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:42.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000daa0 2021-03-09T09:24:42.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:42.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:24:42.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:42.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003790 con 0x7fdd20006b10 2021-03-09T09:24:42.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:42.968+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:24:42.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:42.968+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:24:43.169 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:43.172+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:24:43.170 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:43.172+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:24:43.573 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:43.576+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:24:43.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:43.576+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:24:44.377 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:44.380+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:24:44.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:44.380+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:24:45.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:45.984+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:24:45.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:45.984+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:24:47.447 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:24:47.448+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:24:47.448 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:47.448+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:24:47.448 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:47.448+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:24:47.448 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:47.448+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1811 cs=1 l=1).handle_message read tag failed 2021-03-09T09:24:47.448 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:47.448+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1811 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:24:49.185 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:49.188+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:24:49.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:49.188+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:24:52.447 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:24:52.448+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:24:55.592 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:55.592+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:24:55.593 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:24:55.592+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:24:57.447 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:24:57.448+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:25:02.447 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:25:02.447+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:25:07.448 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:25:07.447+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:25:08.393 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:08.395+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:25:08.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:08.403+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:25:12.448 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:25:12.447+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:25:12.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:12.967+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:25:12.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:12.967+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:25:12.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:12.967+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000daa0 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:25:12.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:12.967+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003390 2021-03-09T09:25:12.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:12.967+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:25:12.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:12.967+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:25:12.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:12.967+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:25:12.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:12.967+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:25:13.169 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:13.171+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:25:13.170 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:13.171+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:25:13.573 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:13.575+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:25:13.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:13.575+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:25:14.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:14.379+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:25:14.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:14.379+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:25:15.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:15.983+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:25:15.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:15.983+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:25:17.449 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:17.447+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:25:17.449 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:17.447+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:25:17.449 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:17.447+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1848 cs=1 l=1).handle_message read tag failed 2021-03-09T09:25:17.450 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:17.447+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1848 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:25:17.450 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:25:17.447+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:25:19.185 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:19.187+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:25:19.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:19.187+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:25:22.449 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:25:22.451+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:25:25.592 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:25.591+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:25:25.593 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:25.591+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:25:27.449 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:25:27.451+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:25:32.449 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:25:32.451+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:25:37.450 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:25:37.451+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:25:38.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:38.407+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:25:38.406 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:38.407+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:25:39.093 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:39.094+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-03-09T09:25:39.093 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:39.094+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:25:39.093 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:39.094+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 0x7fdd2405ba90 :-1 s=OPENED pgs=57 cs=1 l=1).handle_message read tag failed 2021-03-09T09:25:39.094 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:39.094+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 0x7fdd2405ba90 :-1 s=OPENED pgs=57 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:25:39.094 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:39.094+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405ba90 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting, fault. 2021-03-09T09:25:39.094 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:39.094+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405ba90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:25:42.450 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:25:42.450+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:25:42.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:42.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:25:42.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:42.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:25:42.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:42.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:25:42.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:42.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20006ef0 2021-03-09T09:25:42.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:42.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003eb0 2021-03-09T09:25:42.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:42.966+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:25:42.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:42.966+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20006ef0 legacy=0x7fdd200072d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:25:42.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:42.966+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:25:43.169 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:43.170+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20006ef0 legacy=0x7fdd200072d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:25:43.170 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:43.170+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:25:43.573 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:43.574+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20006ef0 legacy=0x7fdd200072d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:25:43.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:43.574+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:25:44.377 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:44.378+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20006ef0 legacy=0x7fdd200072d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:25:44.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:44.378+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:25:45.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:45.982+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20006ef0 legacy=0x7fdd200072d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:25:45.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:45.982+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:25:47.451 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:25:47.450+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:25:47.452 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:47.450+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:25:47.453 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:47.450+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:25:47.453 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:47.450+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1881 cs=1 l=1).handle_message read tag failed 2021-03-09T09:25:47.453 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:47.450+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1881 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:25:49.185 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:49.186+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20006ef0 legacy=0x7fdd200072d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:25:49.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:49.186+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:25:52.451 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:25:52.450+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:25:55.592 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:55.590+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20006ef0 legacy=0x7fdd200072d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:25:55.593 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:25:55.590+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:25:57.451 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:25:57.450+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:26:02.451 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:26:02.450+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:26:07.451 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:26:07.454+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:26:08.393 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:08.394+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20006ef0 legacy=0x7fdd200072d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:26:08.393 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:08.394+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:26:12.453 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:26:12.450+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:26:13.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:12.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:26:13.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:12.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:26:13.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:12.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20006ef0 legacy=0x7fdd200072d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:26:13.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:12.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003390 2021-03-09T09:26:13.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:12.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20003eb0 2021-03-09T09:26:13.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:12.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:26:13.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:12.970+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:26:13.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:12.970+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:26:13.173 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:13.174+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:26:13.174 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:13.174+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:26:13.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:13.578+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:26:13.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:13.578+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:26:14.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:14.382+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:26:14.382 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:14.382+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:26:15.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:15.986+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:26:15.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:15.986+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:26:17.452 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:26:17.454+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:26:17.452 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:17.454+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:26:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:17.454+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:26:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:17.454+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1898 cs=1 l=1).handle_message read tag failed 2021-03-09T09:26:17.453 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:17.454+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1898 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:26:19.187 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:19.190+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:26:19.187 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:19.190+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:26:22.452 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:26:22.453+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:26:25.594 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:25.593+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:26:25.594 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:25.593+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:26:27.452 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:26:27.449+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:26:32.452 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:26:32.449+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:26:37.452 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:26:37.453+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:26:38.407 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:38.409+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:26:38.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:38.409+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:26:42.453 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:26:42.453+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:26:42.968 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:42.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:26:43.353 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:42.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:26:43.353 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:42.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:26:43.354 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:42.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003390 2021-03-09T09:26:43.354 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:42.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:26:43.354 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:42.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20006b10 2021-03-09T09:26:43.355 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:42.969+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:26:43.355 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:42.969+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:26:43.356 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:43.173+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:26:43.356 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:43.173+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:26:43.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:43.577+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:26:43.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:43.577+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:26:44.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:44.381+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:26:44.382 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:44.381+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:26:45.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:45.985+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:26:45.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:45.985+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:26:47.453 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:26:47.453+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:26:47.454 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:47.453+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:26:47.454 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:47.453+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:26:47.454 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:47.453+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1915 cs=1 l=1).handle_message read tag failed 2021-03-09T09:26:47.454 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:47.453+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1915 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:26:49.187 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:49.189+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:26:49.188 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:49.189+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:26:52.453 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:26:52.453+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:26:55.594 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:55.597+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:26:55.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:26:55.597+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:26:57.453 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:26:57.457+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:27:02.454 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:27:02.456+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:27:07.455 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:27:07.456+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:27:08.404 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:08.404+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:27:08.407 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:08.404+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:27:12.454 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:27:12.456+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:27:12.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:12.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:27:12.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:12.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:27:12.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:12.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:27:12.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:12.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003390 2021-03-09T09:27:12.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:12.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:27:12.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:12.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:27:12.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:12.968+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:27:12.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:12.968+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:27:13.173 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:13.172+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:27:13.173 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:13.172+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:27:13.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:13.576+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:27:13.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:13.576+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:27:14.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:14.380+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:27:14.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:14.380+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:27:15.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:15.984+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:27:15.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:15.984+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:27:17.454 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:27:17.452+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:27:17.455 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:17.452+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:27:17.456 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:17.452+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:27:17.456 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:17.452+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1932 cs=1 l=1).handle_message read tag failed 2021-03-09T09:27:17.456 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:17.452+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1932 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:27:19.187 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:19.188+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:27:19.188 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:19.188+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:27:22.455 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:27:22.452+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:27:25.593 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:25.596+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:27:25.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:25.596+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:27:27.455 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:27:27.456+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:27:32.455 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:27:32.456+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:27:37.455 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:27:37.456+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:27:38.406 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:38.408+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:27:38.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:38.408+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:27:42.455 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:27:42.455+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:27:42.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:42.967+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:27:42.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:42.967+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:27:42.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:42.967+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:27:42.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:42.967+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20003eb0 2021-03-09T09:27:42.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:42.971+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20015f50 2021-03-09T09:27:42.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:42.971+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:27:42.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:42.971+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:27:42.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:42.971+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:27:43.173 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:43.175+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:27:43.173 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:43.175+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:27:43.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:43.579+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:27:43.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:43.579+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:27:44.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:44.383+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:27:44.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:44.383+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:27:45.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:45.987+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:27:45.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:45.987+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:27:47.456 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:27:47.455+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:27:47.457 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:47.455+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:27:47.457 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:47.455+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:27:47.457 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:47.455+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1949 cs=1 l=1).handle_message read tag failed 2021-03-09T09:27:47.457 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:47.455+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1949 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:27:49.189 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:49.191+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:27:49.190 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:49.191+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:27:52.456 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:27:52.455+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:27:55.593 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:55.595+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:27:55.593 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:27:55.595+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:27:57.457 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:27:57.455+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:28:02.456 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:28:02.455+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:28:07.457 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:28:07.455+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:28:08.406 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:08.407+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:28:08.406 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:08.407+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:28:12.460 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:28:12.459+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:28:12.969 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:12.971+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:28:12.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:12.971+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:28:12.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:12.971+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:28:12.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:12.971+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003390 2021-03-09T09:28:12.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:12.971+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20015f50 2021-03-09T09:28:12.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:12.971+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:28:12.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:12.971+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:28:12.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:12.971+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:28:13.173 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:13.175+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:28:13.173 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:13.175+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:28:13.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:13.579+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:28:13.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:13.579+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:28:14.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:14.383+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:28:14.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:14.383+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:28:15.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:15.987+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:28:15.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:15.987+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:28:17.457 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:28:17.459+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:28:17.459 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:17.459+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:28:17.459 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:17.459+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:28:17.460 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:17.459+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1966 cs=1 l=1).handle_message read tag failed 2021-03-09T09:28:17.460 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:17.459+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1966 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:28:19.189 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:19.191+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:28:19.189 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:19.191+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:28:22.457 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:28:22.459+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:28:25.596 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:25.598+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:28:25.596 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:25.598+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:28:27.458 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:28:27.458+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:28:32.458 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:28:32.458+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:28:37.458 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:28:37.458+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:28:38.409 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:38.406+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:28:38.409 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:38.406+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:28:42.458 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:28:42.458+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:28:42.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:42.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:28:42.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:42.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:28:42.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:42.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:28:42.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:42.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:28:42.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:42.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20015f50 2021-03-09T09:28:42.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:42.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20006b10 2021-03-09T09:28:42.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:42.970+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:28:42.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:42.970+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:28:43.173 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:43.174+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:28:43.173 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:43.174+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:28:43.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:43.578+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:28:43.957 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:43.578+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:28:44.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:44.382+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:28:44.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:44.382+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:28:45.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:45.986+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:28:45.987 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:45.986+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:28:47.458 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:28:47.458+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:28:47.459 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:47.458+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:28:47.460 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:47.458+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:28:47.460 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:47.458+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1983 cs=1 l=1).handle_message read tag failed 2021-03-09T09:28:47.460 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:47.458+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=1983 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:28:49.188 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:49.190+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:28:49.189 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:49.190+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:28:52.459 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:28:52.462+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:28:55.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:55.598+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:28:55.596 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:28:55.598+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:28:57.459 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:28:57.462+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:29:02.459 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:29:02.458+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:29:07.459 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:29:07.461+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:29:08.407 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:08.409+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:29:08.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:08.409+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:29:12.459 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:29:12.461+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:29:12.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:12.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:29:12.970 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:12.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:29:12.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:12.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:29:12.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:12.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003eb0 2021-03-09T09:29:12.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:12.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20015f50 2021-03-09T09:29:12.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:12.969+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:29:12.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:12.969+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:29:12.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:12.969+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:29:13.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:13.173+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:29:13.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:13.173+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:29:13.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:13.577+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:29:13.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:13.577+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:29:14.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:14.381+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:29:14.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:14.381+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:29:15.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:15.985+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:29:15.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:15.985+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:29:17.460 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:29:17.457+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:29:17.770 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:17.457+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:29:17.770 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:17.457+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:29:17.771 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:17.457+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2000 cs=1 l=1).handle_message read tag failed 2021-03-09T09:29:17.771 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:17.457+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2000 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:29:19.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:19.189+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:29:19.189 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:19.189+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:29:22.460 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:29:22.461+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:29:25.593 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:25.593+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:29:25.596 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:25.593+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:29:27.460 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:29:27.461+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:29:32.460 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:29:32.461+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:29:37.461 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:29:37.457+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:29:38.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:38.405+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:29:38.406 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:38.405+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:29:42.461 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:29:42.460+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:29:42.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:42.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:29:42.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:42.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:29:42.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:42.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:29:42.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:42.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003390 2021-03-09T09:29:42.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:42.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20015f50 2021-03-09T09:29:42.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:42.968+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:29:42.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:42.968+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:29:42.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:42.968+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:29:43.171 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:43.172+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:29:43.172 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:43.172+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:29:43.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:43.576+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:29:43.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:43.576+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:29:44.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:44.380+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:29:44.378 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:44.380+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:29:45.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:45.984+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:29:45.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:45.984+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:29:47.461 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:29:47.460+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:29:47.462 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:47.460+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:29:47.462 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:47.460+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:29:47.463 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:47.460+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2017 cs=1 l=1).handle_message read tag failed 2021-03-09T09:29:47.463 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:47.460+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2017 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:29:49.188 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:49.188+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:29:49.188 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:49.188+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:29:52.462 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:29:52.464+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:29:55.594 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:55.596+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:29:55.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:29:55.596+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:29:57.462 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:29:57.464+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:30:02.462 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:30:02.464+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:30:07.462 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:30:07.464+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:30:08.407 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:08.408+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:30:08.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:08.408+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:30:12.462 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:30:12.463+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:30:12.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:12.971+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:30:12.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:12.971+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:30:12.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:12.971+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:30:12.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:12.971+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20003eb0 2021-03-09T09:30:12.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:12.971+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20015f50 2021-03-09T09:30:12.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:12.971+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:30:12.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:12.971+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:30:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:12.971+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:30:13.173 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:13.175+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:30:13.173 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:13.175+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:30:13.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:13.579+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:30:13.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:13.579+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:30:14.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:14.383+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:30:14.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:14.383+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:30:15.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:15.987+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:30:15.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:15.987+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:30:17.463 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:30:17.463+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:30:17.464 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:17.463+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:30:17.464 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:17.463+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:30:17.464 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:17.463+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2034 cs=1 l=1).handle_message read tag failed 2021-03-09T09:30:17.464 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:17.463+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2034 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:30:19.189 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:19.191+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:30:19.190 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:19.191+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:30:22.463 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:30:22.463+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:30:25.596 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:25.595+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:30:25.596 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:25.595+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:30:27.463 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:30:27.463+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:30:32.464 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:30:32.463+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:30:37.464 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:30:37.463+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:30:38.409 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:38.407+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:30:38.409 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:38.411+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:30:42.464 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:30:42.466+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:30:42.971 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:42.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:30:42.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:42.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:30:42.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:42.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:30:42.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:42.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200103e0 2021-03-09T09:30:42.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:42.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20003390 2021-03-09T09:30:42.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:42.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T09:30:42.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:42.970+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:30:42.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:42.970+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:30:43.173 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:43.174+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:30:43.173 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:43.174+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:30:43.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:43.578+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:30:43.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:43.578+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:30:44.381 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:44.382+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:30:44.382 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:44.382+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:30:45.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:45.986+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:30:45.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:45.986+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:30:47.464 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:30:47.462+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:30:47.465 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:47.462+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:30:47.465 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:47.462+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:30:47.466 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:47.462+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2051 cs=1 l=1).handle_message read tag failed 2021-03-09T09:30:47.466 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:47.462+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2051 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:30:49.188 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:49.190+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:30:49.190 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:49.190+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:30:52.465 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:30:52.462+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:30:55.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:55.594+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:30:55.597 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:30:55.598+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:30:57.465 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:30:57.466+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:31:02.465 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:31:02.466+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:31:07.465 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:31:07.466+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:31:08.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:08.406+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:31:08.410 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:08.410+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:31:12.465 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:31:12.466+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:31:12.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:12.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:31:12.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:12.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:31:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:12.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:31:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:12.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd200103e0 2021-03-09T09:31:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:12.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003390 2021-03-09T09:31:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:12.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20006b10 2021-03-09T09:31:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:12.974+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:31:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:12.974+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:31:13.177 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:13.178+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:31:13.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:13.178+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:31:13.581 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:13.582+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:31:13.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:13.582+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:31:14.388 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:14.385+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:31:14.389 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:14.385+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:31:15.987 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:15.989+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:31:15.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:15.989+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:31:17.466 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:31:17.465+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:31:17.467 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:17.465+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:31:17.467 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:17.465+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:31:17.467 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:17.465+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2068 cs=1 l=1).handle_message read tag failed 2021-03-09T09:31:17.468 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:17.465+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2068 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:31:19.193 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:19.193+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:31:19.194 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:19.193+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:31:22.466 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:31:22.465+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:31:25.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:25.601+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:31:25.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:25.601+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:31:27.466 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:31:27.469+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:31:32.467 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:31:32.465+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:31:37.467 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:31:37.469+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:31:38.413 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:38.413+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:31:38.413 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:38.413+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:31:42.467 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:31:42.469+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:31:42.972 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:31:42.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:31:42.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:31:42.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fd50 con 0x7fdd20005050 2021-03-09T09:31:42.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003390 2021-03-09T09:31:42.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:31:42.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:42.973+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:31:42.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:42.973+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:31:43.177 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:43.177+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:31:43.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:43.177+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:31:43.581 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:43.581+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:31:43.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:43.581+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:31:44.382 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:44.385+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:31:44.383 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:44.385+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:31:45.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:45.989+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:31:45.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:45.989+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:31:47.467 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:31:47.468+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:31:47.468 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:47.468+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:31:47.468 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:47.468+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:31:47.469 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:47.468+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2085 cs=1 l=1).handle_message read tag failed 2021-03-09T09:31:47.469 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:47.468+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2085 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:31:49.193 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:49.192+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:31:49.194 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:49.192+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:31:52.468 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:31:52.468+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:31:55.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:55.600+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:31:55.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:31:55.600+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:31:57.468 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:31:57.468+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:32:02.468 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:32:02.468+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:32:07.468 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:32:07.468+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:32:08.413 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:08.412+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:32:08.414 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:08.416+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:32:12.469 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:32:12.468+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:32:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:12.972+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:32:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:12.972+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:32:12.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:12.972+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:32:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:12.972+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20005050 2021-03-09T09:32:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:12.972+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fd50 con 0x7fdd20003eb0 2021-03-09T09:32:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:12.972+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:32:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:12.972+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:32:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:12.972+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:32:13.173 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:13.176+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:32:13.174 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:13.176+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:32:13.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:13.580+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:32:13.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:13.580+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:32:14.382 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:14.384+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:32:14.382 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:14.384+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:32:15.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:15.988+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:32:15.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:15.988+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:32:17.469 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:32:17.468+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:32:17.470 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:17.468+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:32:17.470 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:17.468+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:32:17.470 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:17.468+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2102 cs=1 l=1).handle_message read tag failed 2021-03-09T09:32:17.470 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:17.468+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2102 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:32:19.189 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:19.191+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:32:19.190 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:19.191+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:32:22.469 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:32:22.471+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:32:25.594 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:25.595+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:32:25.596 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:25.595+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:32:27.470 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:32:27.471+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:32:32.470 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:32:32.471+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:32:37.470 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:32:37.471+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:32:38.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:38.407+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:32:38.409 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:38.411+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:32:42.470 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:32:42.471+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:32:42.973 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:42.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:32:42.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:42.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:32:42.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:42.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20005050 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:32:42.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:42.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003390 2021-03-09T09:32:42.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:42.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20003eb0 2021-03-09T09:32:42.975 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:42.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fd50 con 0x7fdd20006b10 2021-03-09T09:32:42.975 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:42.975+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:32:42.975 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:42.975+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:32:43.177 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:43.179+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:32:43.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:43.179+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:32:43.581 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:43.583+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:32:43.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:43.583+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:32:44.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:44.387+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:32:44.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:44.387+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:32:45.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:45.991+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:32:45.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:45.991+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:32:47.471 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:47.471+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:32:47.471 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:32:47.471+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:32:47.472 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:47.471+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:32:47.472 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:47.471+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2119 cs=1 l=1).handle_message read tag failed 2021-03-09T09:32:47.473 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:47.471+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2119 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:32:49.194 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:49.195+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:32:49.194 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:49.195+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:32:52.471 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:32:52.470+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:32:55.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:55.602+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:32:55.601 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:32:55.602+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:32:57.471 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:32:57.470+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:33:02.471 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:33:02.470+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:33:07.472 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:33:07.470+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:33:08.413 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:08.414+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:33:08.414 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:08.414+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:33:12.472 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:33:12.470+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:33:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:12.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:33:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:12.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:33:12.974 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:12.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:33:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:12.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003390 2021-03-09T09:33:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:12.970+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:33:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:12.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:33:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:12.970+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003770 con 0x7fdd20006b10 2021-03-09T09:33:12.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:12.974+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:33:13.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:13.178+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:33:13.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:13.178+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:33:13.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:13.582+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:33:13.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:13.582+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:33:14.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:14.386+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:33:14.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:14.386+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:33:15.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:15.990+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:33:15.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:15.990+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:33:17.472 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:33:17.470+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:33:17.473 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:17.470+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:33:17.473 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:17.470+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:33:17.473 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:17.470+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2136 cs=1 l=1).handle_message read tag failed 2021-03-09T09:33:17.473 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:17.470+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2136 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:33:19.194 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:19.194+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:33:19.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:19.194+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:33:22.473 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:33:22.470+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:33:25.601 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:25.598+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:33:25.601 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:25.598+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:33:27.473 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:33:27.469+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:33:32.473 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:33:32.473+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:33:37.473 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:33:37.473+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:33:38.414 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:38.413+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:33:38.415 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:38.413+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:33:42.473 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:33:42.473+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:33:42.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:33:42.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:33:42.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003390 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:33:42.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20015320 2021-03-09T09:33:42.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20014f40 2021-03-09T09:33:42.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:33:42.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:42.973+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2001bf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:33:42.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:42.973+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:33:43.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:43.177+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2001bf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:33:43.179 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:43.177+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:33:43.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:43.581+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2001bf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:33:43.583 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:43.581+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:33:44.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:44.385+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2001bf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:33:44.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:44.385+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:33:45.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:45.989+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2001bf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:33:45.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:45.989+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:33:47.474 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:33:47.473+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:33:47.474 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:47.473+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:33:47.475 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:47.473+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:33:47.475 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:47.473+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2153 cs=1 l=1).handle_message read tag failed 2021-03-09T09:33:47.475 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:47.473+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2153 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:33:49.194 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:49.193+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2001bf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:33:49.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:49.193+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:33:52.474 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:33:52.473+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:33:55.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:55.597+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2001bf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:33:55.601 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:33:55.597+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:33:57.474 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:33:57.473+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:34:02.474 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:34:02.476+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:34:07.475 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:34:07.476+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:34:08.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:08.400+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2001bf90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:34:08.413 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:08.412+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:34:12.475 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:34:12.476+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:34:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:12.972+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:34:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:12.972+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:34:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:12.972+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2001bf90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:34:12.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:12.972+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005200 con 0x7fdd20015320 2021-03-09T09:34:12.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:12.972+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T09:34:12.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:12.972+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:34:12.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:12.972+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:34:12.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:12.972+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:34:13.175 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:13.176+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:34:13.175 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:13.176+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:34:13.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:13.580+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:34:13.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:13.580+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:34:14.383 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:14.384+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:34:14.383 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:14.384+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:34:15.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:15.988+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:34:15.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:15.988+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:34:17.475 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:34:17.476+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:34:17.476 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:17.476+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:34:17.476 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:17.476+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:34:17.476 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:17.476+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2170 cs=1 l=1).handle_message read tag failed 2021-03-09T09:34:17.477 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:17.476+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2170 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:34:19.190 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:19.192+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:34:19.193 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:19.192+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:34:22.475 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:34:22.476+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:34:25.597 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:25.596+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:34:25.597 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:25.600+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:34:27.475 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:34:27.476+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:34:32.476 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:34:32.476+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:34:37.476 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:34:37.475+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:34:38.410 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:38.411+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:34:38.410 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:38.411+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:34:42.476 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:34:42.475+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:34:42.975 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:42.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:34:42.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:42.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:34:42.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:42.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:34:42.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:42.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20015320 2021-03-09T09:34:42.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:42.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005200 con 0x7fdd20003eb0 2021-03-09T09:34:42.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:42.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T09:34:42.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:42.975+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:34:42.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:42.975+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:34:43.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:43.179+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:34:43.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:43.179+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:34:43.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:43.583+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:34:43.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:43.583+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:34:44.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:44.387+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:34:44.387 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:44.387+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:34:45.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:45.991+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:34:45.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:45.991+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:34:47.476 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:34:47.475+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:34:47.477 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:47.475+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:34:47.478 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:47.475+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:34:47.478 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:47.475+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2187 cs=1 l=1).handle_message read tag failed 2021-03-09T09:34:47.478 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:47.475+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2187 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:34:49.194 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:49.195+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:34:49.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:49.195+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:34:52.477 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:34:52.475+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:34:55.598 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:55.599+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:34:55.606 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:34:55.599+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:34:57.477 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:34:57.475+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:35:02.477 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:35:02.479+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:35:07.478 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:35:07.479+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:35:08.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:08.407+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:35:08.411 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:08.411+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:35:12.477 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:35:12.478+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:35:12.975 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:12.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:35:12.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:12.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:35:12.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:12.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:35:12.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:12.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20015320 2021-03-09T09:35:12.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:12.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:35:12.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:12.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005200 con 0x7fdd20006b10 2021-03-09T09:35:12.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:12.974+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:35:12.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:12.974+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:35:13.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:13.178+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:35:13.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:13.178+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:35:13.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:13.582+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:35:13.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:13.582+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:35:14.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:14.386+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:35:14.387 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:14.386+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:35:15.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:15.990+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:35:15.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:15.990+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:35:17.478 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:35:17.478+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:35:17.479 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:17.478+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:35:17.479 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:17.478+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:35:17.479 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:17.478+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2204 cs=1 l=1).handle_message read tag failed 2021-03-09T09:35:17.480 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:17.478+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2204 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:35:19.194 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:19.194+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:35:19.194 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:19.194+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:35:22.478 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:35:22.478+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:35:25.599 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:25.598+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:35:25.601 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:25.598+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:35:27.478 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:35:27.478+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:35:32.479 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:35:32.478+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:35:37.479 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:35:37.478+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:35:38.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:38.414+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:35:38.414 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:38.414+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:35:42.479 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:35:42.478+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:35:42.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:42.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:35:42.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:42.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:35:42.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:42.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:35:42.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:42.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20014f40 2021-03-09T09:35:42.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:42.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:35:42.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:42.974+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:35:42.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:42.974+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:35:42.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:42.974+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:35:43.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:43.178+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:35:43.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:43.178+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:35:43.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:43.582+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:35:43.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:43.582+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:35:44.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:44.385+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:35:44.387 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:44.385+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:35:45.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:45.989+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:35:45.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:45.989+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:35:47.480 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:47.477+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:35:47.480 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:47.477+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:35:47.480 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:47.477+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2225 cs=1 l=1).handle_message read tag failed 2021-03-09T09:35:47.481 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:47.477+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2225 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:35:47.481 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:35:47.477+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:35:49.194 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:49.193+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:35:49.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:49.193+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:35:52.480 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:35:52.477+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:35:55.601 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:55.601+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:35:55.601 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:35:55.601+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:35:57.480 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:35:57.481+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:36:02.480 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:36:02.477+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:36:07.481 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:36:07.481+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:36:08.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:08.409+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:36:08.413 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:08.409+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:36:12.481 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:36:12.477+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:36:12.976 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:36:12.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:36:12.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:36:12.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005850 con 0x7fdd20014f40 2021-03-09T09:36:12.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T09:36:12.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:36:12.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:12.977+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:36:12.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:12.977+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:36:13.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:13.181+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:36:13.183 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:13.181+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:36:13.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:13.585+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:36:13.587 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:13.585+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:36:14.387 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:14.389+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:36:14.387 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:14.389+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:36:15.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:15.993+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:36:15.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:15.993+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:36:17.481 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:36:17.481+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:36:17.482 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:17.481+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:36:17.482 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:17.481+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:36:17.482 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:17.481+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2262 cs=1 l=1).handle_message read tag failed 2021-03-09T09:36:17.483 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:17.481+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2262 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:36:19.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:19.197+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:36:19.197 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:19.197+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:36:22.482 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:36:22.480+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:36:25.602 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:25.600+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:36:25.602 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:25.600+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:36:27.482 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:36:27.476+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:36:32.482 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:36:32.480+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:36:37.482 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:36:37.484+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:36:38.414 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:38.412+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:36:38.415 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:38.412+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:36:42.483 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:36:42.484+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:36:42.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:42.976+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:36:42.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:42.976+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:36:42.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:42.976+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:36:42.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:42.976+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20014f40 2021-03-09T09:36:42.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:42.976+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005850 con 0x7fdd20003eb0 2021-03-09T09:36:42.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:42.976+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T09:36:42.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:42.976+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:36:42.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:42.976+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:36:43.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:43.180+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:36:43.179 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:43.180+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:36:43.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:43.584+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:36:43.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:43.584+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:36:44.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:44.388+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:36:44.387 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:44.388+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:36:45.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:45.992+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:36:45.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:45.992+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:36:47.484 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:47.484+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:36:47.485 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:47.484+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:36:47.486 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:47.484+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2299 cs=1 l=1).handle_message read tag failed 2021-03-09T09:36:47.487 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:47.484+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2299 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:36:47.488 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:36:47.484+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:36:49.194 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:49.196+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:36:49.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:49.196+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:36:52.483 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:36:52.484+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:36:55.598 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:55.599+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:36:55.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:36:55.599+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:36:57.483 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:36:57.483+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:37:02.484 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:37:02.483+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:37:07.484 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:37:07.483+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:37:08.411 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:08.411+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:37:08.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:08.411+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:37:12.484 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:37:12.483+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:37:12.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:12.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:37:12.977 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:12.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:37:12.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:12.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:37:12.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:12.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20014f40 2021-03-09T09:37:12.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:12.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:37:12.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:12.975+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005850 con 0x7fdd20006b10 2021-03-09T09:37:12.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:12.975+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:37:12.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:12.975+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:37:13.178 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:13.179+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:37:13.179 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:13.179+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:37:13.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:13.583+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:37:13.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:13.583+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:37:14.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:14.387+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:37:14.386 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:14.387+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:37:15.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:15.991+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:37:15.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:15.991+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:37:17.485 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:37:17.483+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:37:17.485 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:17.483+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:37:17.486 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:17.483+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:37:17.486 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:17.483+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2332 cs=1 l=1).handle_message read tag failed 2021-03-09T09:37:17.486 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:17.483+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2332 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:37:19.194 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:19.195+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:37:19.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:19.195+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:37:22.485 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:37:22.483+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:37:25.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:25.599+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:37:25.601 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:25.599+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:37:27.485 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:37:27.487+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:37:32.485 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:37:32.482+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:37:37.485 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:37:37.482+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:37:38.413 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:38.414+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:37:38.414 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:38.414+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:37:42.486 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:37:42.486+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:37:42.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:42.978+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:37:42.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:42.978+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:37:42.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:42.978+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:37:42.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:42.978+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20014f40 2021-03-09T09:37:42.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:42.978+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:37:42.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:42.978+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:37:42.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:42.978+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:37:42.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:42.978+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:37:43.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:43.182+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:37:43.183 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:43.182+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:37:43.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:43.586+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:37:43.587 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:43.586+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:37:44.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:44.390+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:37:44.391 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:44.390+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:37:45.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:45.994+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:37:45.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:45.994+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:37:47.486 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:47.486+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:37:47.487 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:47.486+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:37:47.487 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:37:47.486+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:37:47.488 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:47.486+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2349 cs=1 l=1).handle_message read tag failed 2021-03-09T09:37:47.488 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:47.486+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2349 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:37:49.198 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:49.198+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:37:49.199 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:49.198+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:37:52.487 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:37:52.486+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:37:55.605 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:55.602+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:37:55.605 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:37:55.602+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:37:57.487 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:37:57.486+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:38:02.487 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:38:02.486+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:38:07.487 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:38:07.485+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:38:08.419 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:08.417+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:38:08.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:08.417+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:38:12.487 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:38:12.485+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:38:12.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:38:12.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:38:12.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:38:12.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20015320 2021-03-09T09:38:12.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T09:38:12.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:38:12.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:12.977+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:38:12.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:12.977+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:38:13.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:13.181+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:38:13.183 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:13.181+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:38:13.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:13.585+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:38:13.588 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:13.585+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:38:14.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:14.389+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:38:14.391 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:14.389+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:38:15.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:15.993+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:38:15.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:15.993+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:38:17.488 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:38:17.485+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:38:17.488 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:17.485+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:38:17.489 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:17.485+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:38:17.489 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:17.485+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2366 cs=1 l=1).handle_message read tag failed 2021-03-09T09:38:17.489 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:17.485+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2366 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:38:19.198 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:19.197+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:38:19.198 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:19.197+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:38:22.488 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:38:22.489+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:38:25.605 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:25.601+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:38:25.605 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:25.601+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:38:27.488 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:38:27.489+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:38:32.488 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:38:32.485+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:38:37.488 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:38:37.485+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:38:38.411 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:38.413+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:38:38.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:38.413+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:38:42.489 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:38:42.489+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:38:42.978 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:38:42.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:38:42.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:38:42.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20015320 2021-03-09T09:38:42.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003eb0 2021-03-09T09:38:42.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:42.973+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T09:38:42.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:42.977+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:38:42.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:42.977+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:38:43.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:43.181+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:38:43.183 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:43.181+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:38:43.583 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:43.585+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:38:43.583 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:43.585+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:38:44.388 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:44.388+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:38:44.388 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:44.388+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:38:45.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:45.992+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:38:45.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:45.992+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:38:47.489 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:38:47.484+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:38:47.490 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:47.484+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:38:47.490 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:47.484+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:38:47.490 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:47.484+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2383 cs=1 l=1).handle_message read tag failed 2021-03-09T09:38:47.491 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:47.484+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2383 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:38:49.197 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:49.196+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:38:49.199 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:49.196+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:38:52.489 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:38:52.484+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:38:55.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:55.604+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:38:55.606 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:38:55.604+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:38:57.490 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:38:57.488+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:39:02.490 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:39:02.488+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:39:07.490 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:39:07.488+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:39:08.417 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:08.416+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:39:08.419 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:08.420+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:39:12.490 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:39:12.492+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:39:12.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:12.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:39:12.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:12.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:39:12.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:12.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:39:12.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:12.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20015320 2021-03-09T09:39:12.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:12.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:39:12.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:12.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:39:12.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:12.980+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:39:12.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:12.980+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:39:13.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:13.184+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:39:13.183 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:13.184+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:39:13.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:13.588+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:39:13.587 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:13.588+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:39:14.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:14.392+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:39:14.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:14.392+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:39:15.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:15.996+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:39:15.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:15.996+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:39:17.490 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:39:17.492+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:39:17.491 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:17.492+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:39:17.492 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:17.492+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:39:17.492 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:17.492+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2400 cs=1 l=1).handle_message read tag failed 2021-03-09T09:39:17.492 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:17.492+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2400 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:39:19.198 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:19.200+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:39:19.198 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:19.200+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:39:22.491 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:39:22.491+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:39:25.605 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:25.603+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:39:25.605 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:25.603+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:39:27.491 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:39:27.491+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:39:32.491 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:39:32.491+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:39:37.491 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:39:37.491+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:39:38.407 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:38.407+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:39:38.407 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:38.407+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:39:42.491 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:39:42.491+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:39:42.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:42.979+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:39:42.979 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:42.979+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:39:42.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:42.979+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:39:42.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:42.979+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20015320 2021-03-09T09:39:42.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:42.979+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:39:42.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:42.979+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:39:42.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:42.979+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:39:42.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:42.979+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:39:43.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:43.183+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:39:43.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:43.183+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:39:43.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:43.587+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:39:43.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:43.587+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:39:44.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:44.391+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:39:44.391 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:44.391+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:39:45.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:45.995+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:39:45.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:45.995+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:39:47.492 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:39:47.491+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:39:47.493 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:47.491+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:39:47.493 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:47.491+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:39:47.493 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:47.491+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2417 cs=1 l=1).handle_message read tag failed 2021-03-09T09:39:47.493 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:47.491+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2417 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:39:49.198 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:49.199+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:39:49.198 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:49.199+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:39:52.492 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:39:52.491+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:39:55.605 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:55.603+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:39:55.605 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:39:55.603+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:39:57.492 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:39:57.491+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:40:02.493 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:40:02.494+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:40:07.493 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:40:07.490+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:40:08.418 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:08.418+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:40:08.418 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:08.418+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:40:12.493 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:40:12.490+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:40:12.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:12.978+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:40:12.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:12.978+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:40:12.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:12.978+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:40:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:12.978+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20015320 2021-03-09T09:40:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:12.978+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T09:40:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:12.978+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:40:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:12.978+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:40:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:12.978+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:40:13.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:13.182+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:40:13.183 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:13.182+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:40:13.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:13.586+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:40:13.587 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:13.586+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:40:14.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:14.390+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:40:14.391 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:14.390+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:40:15.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:15.994+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:40:15.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:15.994+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:40:17.493 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:40:17.490+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:40:17.494 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:17.490+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:40:17.495 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:17.490+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:40:17.495 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:17.490+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2434 cs=1 l=1).handle_message read tag failed 2021-03-09T09:40:17.495 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:17.490+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2434 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:40:19.198 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:19.198+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:40:19.198 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:19.198+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:40:22.494 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:40:22.494+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:40:25.605 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:25.606+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:40:25.605 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:25.606+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:40:27.494 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:40:27.494+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:40:32.494 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:40:32.490+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:40:37.494 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:40:37.493+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:40:38.411 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:38.409+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:40:38.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:38.409+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:40:39.099 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:39.097+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd44064d50 legacy=0x7fdd2406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-03-09T09:40:39.100 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:39.097+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd44064d50 legacy=0x7fdd2406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:40:39.100 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:39.097+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd44064d50 0x7fdd2406c7f0 :-1 s=OPENED pgs=74 cs=1 l=1).handle_message read tag failed 2021-03-09T09:40:39.100 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:39.097+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd44064d50 0x7fdd2406c7f0 :-1 s=OPENED pgs=74 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:40:39.100 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:39.097+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd44064d50 legacy=0x7fdd2406c7f0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting, fault. 2021-03-09T09:40:39.101 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:39.097+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd44064d50 legacy=0x7fdd2406c7f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:40:42.494 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:40:42.493+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:40:42.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:42.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:40:42.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:42.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:40:42.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:42.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:40:42.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:42.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20015320 2021-03-09T09:40:42.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:42.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003eb0 2021-03-09T09:40:42.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:42.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T09:40:42.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:42.977+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:40:42.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:42.977+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:40:43.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:43.181+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:40:43.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:43.181+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:40:43.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:43.585+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:40:43.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:43.585+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:40:44.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:44.389+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:40:44.391 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:44.389+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:40:45.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:45.993+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:40:45.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:45.993+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:40:47.495 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:40:47.493+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:40:47.496 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:47.493+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:40:47.496 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:47.493+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:40:47.496 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:47.493+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2451 cs=1 l=1).handle_message read tag failed 2021-03-09T09:40:47.496 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:47.493+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2451 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:40:49.198 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:49.197+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:40:49.199 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:49.197+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:40:52.495 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:40:52.493+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:40:55.602 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:55.601+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:40:55.602 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:40:55.601+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:40:57.495 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:40:57.493+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:41:02.495 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:41:02.497+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:41:07.495 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:41:07.497+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:41:08.415 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:08.413+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:41:08.415 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:08.413+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:41:12.496 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:41:12.497+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:41:12.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:12.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:41:12.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:12.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:41:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:12.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:41:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:12.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20015320 2021-03-09T09:41:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:12.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:41:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:12.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:41:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:12.981+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:41:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:12.981+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:41:13.184 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:13.185+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:41:13.185 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:13.185+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:41:13.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:13.588+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:41:13.607 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:13.588+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:41:14.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:14.392+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:41:14.395 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:14.392+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:41:15.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:15.996+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:41:15.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:15.996+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:41:17.496 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:17.496+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:41:17.496 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:17.496+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:41:17.497 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:17.496+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2467 cs=1 l=1).handle_message read tag failed 2021-03-09T09:41:17.497 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:17.496+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2467 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:41:17.497 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:41:17.496+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:41:19.202 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:19.200+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:41:19.203 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:19.200+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:41:22.496 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:41:22.496+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:41:25.609 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:25.608+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:41:25.609 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:25.608+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:41:27.496 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:41:27.492+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:41:32.497 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:41:32.496+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:41:37.497 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:41:37.496+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:41:38.422 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:38.420+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:41:38.422 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:38.424+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:41:42.497 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:41:42.496+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:41:42.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:42.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:41:42.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:42.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:41:42.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:42.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:41:42.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:42.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20014f40 2021-03-09T09:41:42.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:42.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:41:42.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:42.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:41:42.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:42.980+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:41:42.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:42.980+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:41:43.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:43.184+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:41:43.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:43.184+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:41:43.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:43.588+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:41:43.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:43.588+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:41:44.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:44.392+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:41:44.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:44.392+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:41:45.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:45.996+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:41:45.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:45.996+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:41:47.497 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:41:47.496+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:41:47.498 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:47.496+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:41:47.498 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:47.496+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:41:47.499 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:47.496+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2484 cs=1 l=1).handle_message read tag failed 2021-03-09T09:41:47.499 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:47.496+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2484 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:41:49.198 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:49.200+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:41:49.199 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:49.200+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:41:52.498 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:41:52.495+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:41:55.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:55.603+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:41:55.606 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:41:55.607+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:41:57.498 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:41:57.495+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:42:02.498 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:42:02.499+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:42:07.498 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:42:07.499+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:42:08.417 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:08.415+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:42:08.419 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:08.419+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:42:12.498 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:42:12.499+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:42:12.980 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:12.979+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:42:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:12.979+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:42:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:12.979+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:42:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:12.979+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20014f40 2021-03-09T09:42:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:12.979+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:42:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:12.979+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20015320 2021-03-09T09:42:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:12.979+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:42:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:12.979+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:42:13.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:13.183+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:42:13.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:13.183+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:42:13.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:13.587+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:42:13.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:13.587+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:42:14.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:14.391+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:42:14.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:14.391+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:42:15.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:15.995+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:42:15.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:15.995+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:42:17.499 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:17.499+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:42:17.499 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:17.499+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:42:17.500 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:17.499+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2501 cs=1 l=1).handle_message read tag failed 2021-03-09T09:42:17.500 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:17.499+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2501 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:42:17.500 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:42:17.499+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:42:19.198 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:19.199+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:42:19.199 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:19.199+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:42:22.499 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:42:22.499+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:42:25.605 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:25.603+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:42:25.605 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:25.603+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:42:27.500 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:42:27.499+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:42:32.499 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:42:32.498+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:42:37.500 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:42:37.498+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:42:38.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:38.414+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:42:38.418 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:38.418+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:42:42.500 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:42:42.498+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:42:42.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:42.982+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:42:42.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:42.982+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:42:42.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:42.982+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:42:42.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:42.982+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20014f40 2021-03-09T09:42:42.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:42.982+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003eb0 2021-03-09T09:42:42.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:42.982+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T09:42:42.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:42.982+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:42:42.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:42.982+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:42:43.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:43.186+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:42:43.187 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:43.186+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:42:43.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:43.590+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:42:43.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:43.590+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:42:44.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:44.394+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:42:44.395 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:44.394+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:42:45.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:45.998+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:42:45.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:45.998+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:42:47.501 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:42:47.498+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:42:47.502 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:47.498+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:42:47.502 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:47.498+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:42:47.503 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:47.498+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2518 cs=1 l=1).handle_message read tag failed 2021-03-09T09:42:47.503 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:47.498+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2518 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:42:49.202 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:49.202+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:42:49.203 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:49.202+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:42:52.500 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:42:52.502+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:42:55.609 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:55.610+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:42:55.609 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:42:55.610+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:42:57.501 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:42:57.502+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:43:02.501 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:43:02.502+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:43:07.501 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:43:07.502+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:43:08.415 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:08.413+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:43:08.421 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:08.417+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:43:12.501 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:43:12.501+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:43:12.981 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:43:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:43:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:43:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20014f40 2021-03-09T09:43:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20015320 2021-03-09T09:43:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:12.977+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:43:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:12.977+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:43:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:12.977+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:43:13.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:13.181+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:43:13.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:13.181+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:43:13.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:13.585+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:43:13.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:13.585+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:43:14.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:14.389+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:43:14.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:14.389+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:43:15.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:15.993+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:43:15.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:15.993+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:43:17.502 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:43:17.501+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:43:17.502 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:17.501+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:43:17.503 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:17.501+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:43:17.503 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:17.501+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2535 cs=1 l=1).handle_message read tag failed 2021-03-09T09:43:17.503 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:17.501+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2535 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:43:19.198 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:19.197+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:43:19.198 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:19.197+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:43:22.502 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:43:22.501+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:43:25.602 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:25.601+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:43:25.602 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:25.601+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:43:27.502 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:43:27.501+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:43:32.502 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:43:32.501+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:43:37.502 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:43:37.501+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:43:38.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:38.405+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:43:38.415 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:38.413+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:43:42.503 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:43:42.501+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:43:42.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:42.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:43:42.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:42.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:43:42.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:42.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:43:42.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:42.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20014f40 2021-03-09T09:43:42.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:42.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20015320 2021-03-09T09:43:42.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:42.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:43:42.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:42.981+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:43:42.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:42.981+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:43:43.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:43.185+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:43:43.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:43.185+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:43:43.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:43.589+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:43:43.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:43.589+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:43:44.391 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:44.393+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:43:44.391 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:44.393+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:43:45.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:45.997+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:43:45.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:45.997+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:43:47.503 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:47.504+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:43:47.504 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:47.504+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:43:47.504 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:47.504+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2552 cs=1 l=1).handle_message read tag failed 2021-03-09T09:43:47.504 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:47.504+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2552 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:43:47.504 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:43:47.504+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:43:49.202 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:49.200+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:43:49.203 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:49.200+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:43:52.503 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:43:52.500+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:43:55.609 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:55.608+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:43:55.609 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:43:55.608+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:43:57.504 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:43:57.504+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:44:02.504 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:44:02.504+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:44:07.504 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:44:07.504+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:44:08.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:08.412+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:44:08.418 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:08.420+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:44:12.504 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:44:12.504+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:44:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:12.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:44:12.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:12.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:44:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:12.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:44:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:12.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20003eb0 2021-03-09T09:44:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:12.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20015320 2021-03-09T09:44:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:12.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:44:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:12.980+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:44:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:12.984+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:44:13.182 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:13.184+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:44:13.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:13.188+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:44:13.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:13.588+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:44:13.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:13.592+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:44:14.390 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:14.392+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:44:14.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:14.396+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:44:15.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:15.996+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:44:15.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:16.000+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:44:17.505 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:44:17.504+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:44:17.505 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:17.504+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:44:17.506 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:17.504+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:44:17.506 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:17.504+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2569 cs=1 l=1).handle_message read tag failed 2021-03-09T09:44:17.506 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:17.504+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2569 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:44:19.198 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:19.200+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:44:19.202 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:19.204+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:44:22.505 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:44:22.504+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:44:25.605 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:25.603+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:44:25.606 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:25.607+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:44:27.505 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:44:27.503+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:44:32.505 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:44:32.503+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:44:37.505 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:44:37.503+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:44:38.415 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:38.415+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:44:38.415 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:38.415+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:44:42.505 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:44:42.507+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:44:42.982 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:42.979+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:44:42.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:42.979+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:44:42.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:42.983+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:44:42.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:42.983+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:44:42.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:42.983+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20015320 2021-03-09T09:44:42.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:42.983+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T09:44:42.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:42.983+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:44:42.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:42.983+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:44:43.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:43.187+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:44:43.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:43.187+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:44:43.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:43.591+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:44:43.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:43.591+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:44:44.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:44.395+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:44:44.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:44.395+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:44:45.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:45.999+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:44:45.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:45.999+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:44:47.506 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:44:47.507+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:44:47.507 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:47.507+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:44:47.507 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:47.507+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:44:47.508 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:47.507+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2586 cs=1 l=1).handle_message read tag failed 2021-03-09T09:44:47.508 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:47.507+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2586 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:44:49.202 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:49.203+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:44:49.203 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:49.203+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:44:52.506 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:44:52.507+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:44:55.609 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:55.607+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:44:55.609 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:44:55.607+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:44:57.507 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:44:57.507+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:45:02.507 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:45:02.507+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:45:07.507 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:45:07.506+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:45:08.411 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:08.410+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:45:08.422 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:08.422+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:45:12.507 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:45:12.506+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:45:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:12.982+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:45:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:12.982+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:45:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:12.982+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:45:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:12.982+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:45:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:12.982+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20015320 2021-03-09T09:45:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:12.982+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:45:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:12.982+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:45:12.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:12.982+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:45:13.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:13.186+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:45:13.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:13.186+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:45:13.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:13.590+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:45:13.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:13.590+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:45:14.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:14.394+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:45:14.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:14.394+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:45:15.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:15.998+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:45:15.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:15.998+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:45:17.507 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:45:17.506+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:45:17.508 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:17.506+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:45:17.508 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:17.506+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:45:17.509 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:17.506+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2603 cs=1 l=1).handle_message read tag failed 2021-03-09T09:45:17.509 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:17.506+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2603 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:45:19.201 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:19.202+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:45:19.201 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:19.202+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:45:22.508 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:45:22.506+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:45:25.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:25.606+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:45:25.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:25.606+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:45:27.508 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:45:27.510+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:45:32.508 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:45:32.510+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:45:37.508 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:45:37.510+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:45:38.421 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:38.422+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:45:38.421 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:38.422+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:45:42.508 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:45:42.510+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:45:42.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:42.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:45:42.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:42.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:45:42.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:42.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:45:42.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:42.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20014f40 2021-03-09T09:45:42.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:42.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20015320 2021-03-09T09:45:42.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:42.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:45:42.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:42.981+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:45:42.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:42.981+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:45:43.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:43.185+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:45:43.187 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:43.185+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:45:43.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:43.589+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:45:43.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:43.589+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:45:44.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:44.393+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:45:44.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:44.393+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:45:45.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:45.997+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:45:45.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:45.997+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:45:47.509 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:45:47.509+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:45:47.510 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:47.509+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:45:47.510 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:47.509+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:45:47.511 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:47.509+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2620 cs=1 l=1).handle_message read tag failed 2021-03-09T09:45:47.511 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:47.509+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2620 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:45:49.202 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:49.201+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:45:49.202 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:49.201+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:45:52.509 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:45:52.509+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:45:55.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:55.609+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:45:55.609 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:45:55.609+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:45:57.509 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:45:57.505+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:46:02.509 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:46:02.509+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:46:07.510 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:46:07.505+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:46:08.421 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:08.421+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:46:08.422 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:08.421+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:46:12.510 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:46:12.509+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:46:12.983 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:12.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:46:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:12.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:46:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:12.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd20018780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:46:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:12.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20014f40 2021-03-09T09:46:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:12.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20015320 2021-03-09T09:46:12.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:12.981+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:46:12.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:12.981+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:46:12.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:12.981+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:46:13.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:13.185+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:46:13.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:13.185+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:46:13.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:13.589+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:46:13.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:13.589+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:46:14.397 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:14.393+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:46:14.397 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:14.393+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:46:15.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:15.997+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:46:15.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:15.997+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:46:17.510 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:46:17.509+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:46:17.511 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:17.509+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:46:17.511 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:17.509+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:46:17.511 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:17.509+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2637 cs=1 l=1).handle_message read tag failed 2021-03-09T09:46:17.512 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:17.509+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2637 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:46:19.200 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:19.201+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:46:19.201 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:19.201+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:46:22.510 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:46:22.508+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:46:25.607 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:25.604+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:46:25.607 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:25.604+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:46:27.512 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:46:27.512+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:46:32.511 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:46:32.512+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:46:37.511 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:46:37.508+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:46:38.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:38.420+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:46:38.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:38.420+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:46:42.511 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:46:42.512+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:46:42.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:42.984+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:46:42.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:42.984+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:46:42.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:42.984+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:46:42.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:42.984+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:46:42.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:42.984+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20015320 2021-03-09T09:46:42.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:42.984+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T09:46:42.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:42.984+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:46:42.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:42.984+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:46:43.190 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:43.188+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:46:43.190 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:43.188+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:46:43.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:43.592+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:46:43.591 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:43.592+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:46:44.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:44.396+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:46:44.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:44.396+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:46:45.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:46.000+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:46:45.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:46.000+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:46:47.512 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:46:47.512+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:46:47.512 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:47.512+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:46:47.513 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:47.512+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:46:47.513 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:47.512+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2654 cs=1 l=1).handle_message read tag failed 2021-03-09T09:46:47.513 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:47.512+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2654 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:46:49.202 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:49.204+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:46:49.202 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:49.204+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:46:52.512 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:46:52.512+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:46:55.609 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:55.608+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:46:55.609 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:46:55.608+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:46:57.512 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:46:57.512+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:47:02.512 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:47:02.511+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:47:07.513 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:47:07.511+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:47:08.421 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:08.419+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:47:08.422 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:08.423+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:47:12.513 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:47:12.511+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:47:12.984 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:12.983+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:47:13.064 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:12.983+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:47:13.064 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:12.983+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:47:13.065 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:12.983+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:47:13.065 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:12.983+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20015320 2021-03-09T09:47:13.065 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:12.983+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005810 con 0x7fdd20006b10 2021-03-09T09:47:13.065 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:12.983+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:47:13.065 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:12.983+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:47:13.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:13.187+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:47:13.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:13.187+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:47:13.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:13.591+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:47:13.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:13.591+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:47:14.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:14.395+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:47:14.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:14.395+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:47:15.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:15.999+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:47:15.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:15.999+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:47:17.513 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:47:17.511+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:47:17.514 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:17.511+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:47:17.514 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:17.511+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:47:17.515 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:17.511+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2675 cs=1 l=1).handle_message read tag failed 2021-03-09T09:47:17.515 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:17.511+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2675 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:47:19.202 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:19.203+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:47:19.203 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:19.203+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:47:22.514 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:47:22.515+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:47:25.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:25.607+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:47:25.609 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:25.607+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:47:27.514 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:47:27.515+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:47:32.514 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:47:32.514+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:47:37.515 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:47:37.514+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:47:38.418 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:38.418+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:47:38.419 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:38.418+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:47:42.515 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:47:42.514+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:47:42.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:42.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:47:42.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:42.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015320 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:47:42.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:42.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:47:42.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:42.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005240 con 0x7fdd20003eb0 2021-03-09T09:47:42.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:42.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20014f40 2021-03-09T09:47:42.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:42.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:47:42.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:42.986+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:47:42.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:42.986+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:47:43.189 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:43.190+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:47:43.190 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:43.190+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:47:43.594 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:43.594+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:47:43.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:43.594+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:47:44.398 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:44.398+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:47:44.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:44.398+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:47:46.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:46.002+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:47:46.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:46.002+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:47:47.515 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:47:47.514+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:47:47.516 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:47.514+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:47:47.516 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:47.514+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:47:47.516 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:47.514+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2712 cs=1 l=1).handle_message read tag failed 2021-03-09T09:47:47.517 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:47.514+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2712 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:47:49.206 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:49.206+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:47:49.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:49.206+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:47:52.516 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:47:52.514+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:47:55.613 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:55.610+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:47:55.658 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:47:55.610+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:47:57.516 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:47:57.518+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:48:02.516 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:48:02.517+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:48:07.517 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:48:07.517+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:48:08.426 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:08.425+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:48:08.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:08.425+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:48:12.517 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:48:12.517+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:48:12.985 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:12.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:48:12.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:12.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014f40 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:48:12.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:12.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:48:12.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:12.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T09:48:12.987 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:12.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005240 con 0x7fdd20016330 2021-03-09T09:48:12.987 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:12.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:48:12.987 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:12.985+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:48:12.987 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:12.985+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:48:13.190 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:13.189+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:48:13.191 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:13.189+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:48:13.594 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:13.593+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:48:13.594 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:13.593+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:48:14.398 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:14.397+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:48:14.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:14.397+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:48:16.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:16.001+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:48:16.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:16.001+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:48:17.517 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:17.517+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:48:17.518 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:17.517+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:48:17.518 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:17.517+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2749 cs=1 l=1).handle_message read tag failed 2021-03-09T09:48:17.518 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:17.517+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2749 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:48:17.519 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:48:17.517+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:48:19.206 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:19.205+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:48:19.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:19.205+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:48:22.518 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:48:22.517+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:48:25.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:25.609+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:48:25.613 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:25.609+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:48:27.518 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:48:27.517+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:48:32.518 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:48:32.517+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:48:37.519 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:48:37.520+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:48:38.421 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:38.420+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:48:38.426 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:38.424+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:48:42.519 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:48:42.520+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:48:42.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:42.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:48:42.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:42.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:48:42.986 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:42.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:48:42.987 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:42.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:48:42.987 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:42.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20016330 2021-03-09T09:48:42.987 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:42.980+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005240 con 0x7fdd20006b10 2021-03-09T09:48:42.987 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:42.980+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:48:42.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:42.980+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:48:43.186 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:43.184+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:48:43.187 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:43.184+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:48:43.587 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:43.588+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:48:43.588 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:43.588+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:48:44.394 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:44.392+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:48:44.395 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:44.392+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:48:45.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:45.996+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:48:45.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:45.996+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:48:47.519 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:48:47.520+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:48:47.520 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:47.520+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:48:47.520 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:47.520+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:48:47.520 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:47.520+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2782 cs=1 l=1).handle_message read tag failed 2021-03-09T09:48:47.521 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:47.520+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=2782 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:48:49.203 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:49.200+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:48:49.203 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:49.200+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:48:52.520 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:48:52.520+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:48:55.609 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:55.608+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:48:55.610 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:48:55.608+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:48:57.520 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:48:57.520+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:49:02.520 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:49:02.520+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:49:07.520 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:49:07.519+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:49:08.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:08.423+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:49:08.430 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:08.423+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:49:12.520 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:49:12.519+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:49:12.987 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:12.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:49:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:12.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:49:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:12.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:49:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:12.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003320 2021-03-09T09:49:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:12.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20016330 2021-03-09T09:49:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:12.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T09:49:12.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:12.987+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:49:12.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:12.987+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:49:13.193 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:13.191+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:49:13.194 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:13.191+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:49:13.594 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:13.595+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:49:13.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:13.595+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:49:14.398 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:14.399+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:49:14.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:14.399+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:49:16.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:16.003+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:49:16.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:16.003+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:49:17.521 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:49:17.519+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:49:17.522 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:17.519+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:49:17.522 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:17.519+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:49:17.522 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:17.519+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000ef30 :-1 s=OPENED pgs=2799 cs=1 l=1).handle_message read tag failed 2021-03-09T09:49:17.522 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:17.519+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000ef30 :-1 s=OPENED pgs=2799 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:49:19.206 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:19.207+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:49:19.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:19.207+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:49:22.521 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:49:22.519+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:49:25.613 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:25.611+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:49:25.614 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:25.611+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:49:27.521 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:49:27.519+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:49:32.522 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:49:32.523+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:49:37.522 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:49:37.519+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:49:38.426 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:38.422+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:49:38.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:38.426+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:49:42.522 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:49:42.518+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:49:42.987 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:42.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:49:42.987 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:42.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20016330 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:49:42.987 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:42.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:49:42.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:42.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005240 con 0x7fdd20003eb0 2021-03-09T09:49:42.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:42.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20015840 2021-03-09T09:49:42.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:42.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:49:42.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:42.986+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:49:42.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:42.986+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd2001c790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:49:43.190 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:43.190+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:49:43.191 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:43.190+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd2001c790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:49:43.594 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:43.594+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:49:43.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:43.594+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd2001c790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:49:44.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:44.398+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:49:44.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:44.398+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd2001c790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:49:46.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:46.002+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:49:46.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:46.002+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd2001c790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:49:47.523 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:49:47.522+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:49:47.527 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:47.522+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:49:47.529 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:47.522+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:49:47.530 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:47.522+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2816 cs=1 l=1).handle_message read tag failed 2021-03-09T09:49:47.532 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:47.522+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2816 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:49:49.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:49.206+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:49:49.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:49.206+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd2001c790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:49:52.523 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:49:52.522+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:49:55.613 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:55.610+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:49:55.614 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:49:55.610+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd2001c790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:49:57.523 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:49:57.522+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:50:02.523 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:50:02.522+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:50:07.523 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:50:07.522+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:50:08.426 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:08.426+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:50:08.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:08.426+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd2001c790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:50:12.523 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:50:12.521+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:50:12.987 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:12.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:50:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:12.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd2001c790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:50:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:12.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:50:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:12.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003320 2021-03-09T09:50:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:12.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005240 con 0x7fdd20015840 2021-03-09T09:50:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:12.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:50:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:12.985+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:50:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:12.985+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:50:13.191 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:13.189+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:50:13.191 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:13.189+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:50:13.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:13.593+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:50:13.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:13.593+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:50:14.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:14.397+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:50:14.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:14.397+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:50:16.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:16.001+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:50:16.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:16.001+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:50:17.524 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:50:17.521+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:50:17.525 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:17.521+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:50:17.525 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:17.521+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:50:17.525 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:17.521+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2833 cs=1 l=1).handle_message read tag failed 2021-03-09T09:50:17.526 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:17.521+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2833 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:50:19.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:19.205+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:50:19.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:19.205+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:50:22.524 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:50:22.521+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:50:25.614 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:25.613+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:50:25.614 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:25.613+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:50:27.524 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:50:27.525+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:50:32.525 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:50:32.525+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:50:37.525 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:50:37.525+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:50:38.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:38.425+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:50:38.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:38.425+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:50:42.525 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:50:42.525+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:50:42.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:42.989+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:50:43.126 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:42.989+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015840 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:50:43.127 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:42.989+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:50:43.127 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:42.989+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003320 2021-03-09T09:50:43.127 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:42.989+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T09:50:43.128 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:42.989+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005240 con 0x7fdd20006b10 2021-03-09T09:50:43.128 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:42.989+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:50:43.128 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:42.989+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:50:43.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:43.193+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:50:43.196 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:43.193+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:50:43.599 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:43.597+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:50:43.599 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:43.597+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:50:44.400 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:44.401+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:50:44.400 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:44.401+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:50:46.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:46.004+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:50:46.129 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:46.004+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:50:47.525 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:50:47.524+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:50:47.526 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:47.524+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:50:47.527 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:47.524+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:50:47.527 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:47.524+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2850 cs=1 l=1).handle_message read tag failed 2021-03-09T09:50:47.527 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:47.524+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2850 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:50:49.211 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:49.208+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:50:49.211 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:49.208+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:50:52.526 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:50:52.524+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:50:55.617 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:55.616+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:50:55.618 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:50:55.616+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:50:57.526 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:50:57.524+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:51:02.526 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:51:02.524+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:51:07.526 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:51:07.524+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:51:08.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:08.432+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:51:08.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:08.432+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:51:12.527 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:51:12.528+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:51:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:12.988+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:51:12.988 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:12.988+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:51:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:12.988+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:51:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:12.988+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003320 2021-03-09T09:51:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:12.988+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:51:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:12.988+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T09:51:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:12.988+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:51:12.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:12.988+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:51:13.191 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:13.192+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:51:13.191 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:13.192+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:51:13.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:13.596+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:51:13.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:13.596+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:51:14.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:14.400+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:51:14.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:14.400+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:51:16.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:16.004+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:51:16.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:16.004+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:51:17.527 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:51:17.528+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:51:17.528 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:17.528+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:51:17.528 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:17.528+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:51:17.528 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:17.528+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2867 cs=1 l=1).handle_message read tag failed 2021-03-09T09:51:17.529 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:17.528+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2867 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:51:19.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:19.207+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:51:19.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:19.207+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:51:22.527 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:51:22.527+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:51:25.613 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:25.611+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:51:25.614 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:25.611+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:51:27.529 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:51:27.527+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:51:32.527 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:51:32.527+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:51:37.528 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:51:37.527+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:51:38.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:38.427+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:51:38.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:38.427+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:51:42.528 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:51:42.527+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:51:42.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:42.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:51:42.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:42.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:51:42.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:42.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:51:42.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:42.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005220 con 0x7fdd20003320 2021-03-09T09:51:42.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:42.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:51:42.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:42.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:51:42.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:42.987+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:51:42.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:42.987+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:51:43.191 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:43.191+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:51:43.191 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:43.191+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:51:43.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:43.595+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:51:43.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:43.595+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:51:44.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:44.399+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:51:44.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:44.399+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:51:46.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:46.003+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:51:46.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:46.003+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:51:47.528 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:51:47.527+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:51:47.529 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:47.527+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:51:47.529 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:47.527+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:51:47.529 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:47.527+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2884 cs=1 l=1).handle_message read tag failed 2021-03-09T09:51:47.530 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:47.527+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2884 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:51:49.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:49.207+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:51:49.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:49.207+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:51:52.529 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:51:52.527+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:51:55.614 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:55.610+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:51:55.614 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:51:55.610+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:51:57.529 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:51:57.526+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:52:02.529 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:52:02.526+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:52:07.529 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:52:07.530+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:52:08.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:08.414+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:52:08.426 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:08.422+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:52:12.529 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:52:12.530+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:52:12.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:12.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:52:12.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:12.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:52:12.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:12.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:52:12.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:12.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003320 2021-03-09T09:52:12.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:12.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005220 con 0x7fdd20003eb0 2021-03-09T09:52:12.991 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:12.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:52:12.991 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:12.986+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:52:12.991 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:12.986+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:52:13.190 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:13.190+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:52:13.190 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:13.190+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:52:13.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:13.594+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:52:13.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:13.594+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:52:14.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:14.398+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:52:14.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:14.398+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:52:16.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:16.002+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:52:16.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:16.002+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:52:17.530 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:52:17.526+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:52:17.530 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:17.526+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:52:17.531 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:17.526+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:52:17.531 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:17.526+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2901 cs=1 l=1).handle_message read tag failed 2021-03-09T09:52:17.531 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:17.526+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2901 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:52:19.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:19.206+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:52:19.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:19.206+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:52:22.530 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:52:22.530+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:52:25.613 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:25.614+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:52:25.614 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:25.614+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:52:27.530 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:52:27.529+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:52:32.530 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:52:32.525+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:52:37.530 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:52:37.529+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:52:38.419 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:38.417+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:52:38.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:38.425+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:52:42.531 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:52:42.529+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:52:42.989 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:42.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:52:42.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:42.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:52:42.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:42.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003320 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:52:42.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:42.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20008610 2021-03-09T09:52:42.991 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:42.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T09:52:42.991 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:42.985+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005220 con 0x7fdd20006b10 2021-03-09T09:52:42.991 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:42.985+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:52:42.991 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:42.985+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:52:43.191 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:43.189+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:52:43.191 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:43.189+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:52:43.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:43.593+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:52:43.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:43.593+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:52:44.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:44.397+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:52:44.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:44.397+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:52:46.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:46.001+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:52:46.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:46.001+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:52:47.531 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:52:47.529+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:52:47.532 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:47.529+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:52:47.532 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:47.529+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:52:47.532 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:47.529+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2918 cs=1 l=1).handle_message read tag failed 2021-03-09T09:52:47.533 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:47.529+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2918 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:52:49.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:49.205+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:52:49.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:49.205+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:52:52.531 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:52:52.529+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:52:55.614 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:55.613+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:52:55.614 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:52:55.613+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:52:57.532 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:52:57.533+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:53:02.532 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:53:02.528+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:53:07.532 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:53:07.532+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:53:08.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:08.416+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:53:08.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:08.420+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:53:12.532 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:53:12.532+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:53:12.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:12.988+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:53:12.991 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:12.988+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:53:12.991 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:12.988+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:53:12.991 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:12.988+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd200089f0 2021-03-09T09:53:12.991 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:12.988+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:53:12.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:12.988+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:53:12.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:12.988+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T09:53:12.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:12.988+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:53:13.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:13.192+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:53:13.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:13.192+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:53:13.596 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:13.596+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:53:13.596 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:13.596+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:53:14.403 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:14.400+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:53:14.404 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:14.400+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:53:16.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:16.004+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:53:16.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:16.004+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:53:17.532 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:53:17.532+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:53:17.533 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:17.532+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:53:17.534 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:17.532+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:53:17.534 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:17.532+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2935 cs=1 l=1).handle_message read tag failed 2021-03-09T09:53:17.534 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:17.532+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2935 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:53:19.211 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:19.208+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:53:19.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:19.208+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:53:22.533 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:53:22.532+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:53:25.611 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:25.612+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:53:25.618 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:25.616+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:53:27.533 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:53:27.532+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:53:32.533 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:53:32.532+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:53:37.533 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:53:37.531+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:53:38.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:38.423+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:53:38.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:38.427+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:53:42.533 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:53:42.531+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:53:42.990 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:42.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:53:42.991 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:42.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:53:42.991 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:42.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:53:42.991 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:42.987+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:53:42.991 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:42.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005220 con 0x7fdd20008610 2021-03-09T09:53:42.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:42.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:53:42.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:42.987+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:53:42.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:42.987+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:53:43.191 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:43.191+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:53:43.191 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:43.191+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:53:43.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:43.595+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:53:43.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:43.595+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:53:44.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:44.399+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:53:44.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:44.399+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:53:46.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:46.003+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:53:46.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:46.003+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:53:47.534 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:53:47.531+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:53:47.535 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:47.531+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:53:47.535 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:47.531+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:53:47.535 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:47.531+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2952 cs=1 l=1).handle_message read tag failed 2021-03-09T09:53:47.535 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:47.531+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2952 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:53:49.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:49.207+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:53:49.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:49.207+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:53:52.534 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:53:52.531+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:53:55.614 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:55.611+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:53:55.614 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:53:55.611+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:53:57.534 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:53:57.535+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:54:02.534 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:54:02.531+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:54:07.535 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:54:07.535+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:54:08.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:08.423+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:54:08.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:08.427+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:54:12.535 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:54:12.534+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:12.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:12.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:54:12.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:12.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:54:12.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:12.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20008610 2021-03-09T09:54:12.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:12.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005220 con 0x7fdd200089f0 2021-03-09T09:54:12.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:12.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:54:12.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:12.986+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:54:12.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:12.986+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:54:13.191 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:13.190+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:54:13.191 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:13.190+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:13.594+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:13.594+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:54:14.399 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:14.398+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:54:14.521 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:14.398+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:54:16.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:16.002+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:54:16.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:16.002+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:54:17.535 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:54:17.534+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:54:17.536 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:17.534+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:54:17.537 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:17.534+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:54:17.537 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:17.534+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2969 cs=1 l=1).handle_message read tag failed 2021-03-09T09:54:17.537 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:17.534+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2969 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:54:19.210 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:19.206+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:54:19.211 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:19.206+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:54:22.536 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:54:22.534+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:54:25.611 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:25.610+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:54:25.613 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:25.610+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:54:27.536 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:54:27.534+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:54:32.536 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:54:32.534+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:54:37.536 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:54:37.534+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:54:38.422 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:38.422+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:54:38.426 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:38.422+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:54:42.536 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:54:42.534+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:54:42.991 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:42.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:54:42.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:42.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:54:42.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:42.986+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:54:42.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:42.990+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20008610 2021-03-09T09:54:42.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:42.990+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T09:54:42.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:42.990+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005220 con 0x7fdd20006b10 2021-03-09T09:54:42.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:42.990+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:54:42.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:42.990+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:54:43.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:43.194+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:54:43.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:43.194+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:54:43.599 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:43.598+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:54:43.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:43.598+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:54:44.403 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:44.402+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:54:44.404 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:44.402+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:54:46.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:46.006+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:54:46.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:46.006+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:54:47.537 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:47.534+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:54:47.537 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:47.534+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:54:47.538 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:47.534+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2986 cs=1 l=1).handle_message read tag failed 2021-03-09T09:54:47.538 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:47.534+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=2986 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:54:47.538 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:54:47.534+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:54:49.211 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:49.209+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:54:49.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:49.209+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:54:52.537 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:54:52.533+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:54:55.618 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:55.617+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:54:55.619 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:54:55.617+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:54:57.537 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:54:57.533+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:55:02.539 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:55:02.537+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:55:07.538 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:55:07.537+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:55:08.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:08.429+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:55:08.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:08.429+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:55:12.538 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:55:12.537+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:55:12.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:12.989+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:55:12.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:12.989+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:55:12.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:12.989+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:55:12.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:12.989+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd200089f0 2021-03-09T09:55:12.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:12.989+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200032a0 2021-03-09T09:55:12.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:12.989+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T09:55:12.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:12.989+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:55:12.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:12.989+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:55:13.192 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:13.193+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:55:13.193 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:13.193+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:55:13.599 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:13.597+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:55:13.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:13.597+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:55:14.400 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:14.401+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:55:14.401 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:14.401+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:55:16.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:16.005+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:55:16.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:16.005+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:55:17.538 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:55:17.537+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:55:17.539 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:17.537+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:55:17.539 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:17.537+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:55:17.539 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:17.537+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3003 cs=1 l=1).handle_message read tag failed 2021-03-09T09:55:17.539 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:17.537+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3003 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:55:19.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:19.209+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:55:19.210 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:19.209+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:55:22.538 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:55:22.537+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:55:25.614 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:25.612+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:55:25.617 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:25.612+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:55:27.538 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:55:27.536+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:55:32.539 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:55:32.536+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:55:37.545 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:55:37.536+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:55:38.423 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:38.420+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:55:38.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:38.424+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:55:39.103 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:39.100+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-03-09T09:55:39.103 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:39.100+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:55:39.103 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:39.100+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 0x7fdd2405ba90 :-1 s=OPENED pgs=88 cs=1 l=1).handle_message read tag failed 2021-03-09T09:55:39.104 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:39.100+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 0x7fdd2405ba90 :-1 s=OPENED pgs=88 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:55:39.104 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:39.100+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405ba90 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting, fault. 2021-03-09T09:55:39.104 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:39.100+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405ba90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:55:42.539 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:55:42.536+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:55:42.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:42.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:55:42.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:42.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:55:42.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:42.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:55:42.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:42.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005200 con 0x7fdd200089f0 2021-03-09T09:55:42.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:42.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:55:42.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:42.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:55:42.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:42.992+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:55:42.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:42.992+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:55:43.199 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:43.196+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:55:43.200 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:43.196+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:55:43.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:43.600+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:55:43.601 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:43.600+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:55:44.403 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:44.404+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:55:44.404 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:44.404+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:55:46.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:46.008+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:55:46.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:46.008+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:55:47.539 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:55:47.540+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:55:47.540 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:47.540+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:55:47.540 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:47.540+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:55:47.541 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:47.540+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3020 cs=1 l=1).handle_message read tag failed 2021-03-09T09:55:47.541 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:47.540+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3020 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:55:49.211 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:49.212+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:55:49.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:49.212+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:55:52.539 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:55:52.540+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:55:55.618 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:55.616+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:55:55.618 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:55:55.616+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:55:57.540 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:55:57.540+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:56:02.540 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:56:02.539+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:56:07.540 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:56:07.539+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:56:08.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:08.431+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:56:08.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:08.431+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:56:12.540 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:56:12.539+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:56:12.992 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:12.991+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:56:12.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:12.991+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:56:12.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:12.991+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:56:12.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:12.991+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20008610 2021-03-09T09:56:12.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:12.991+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005200 con 0x7fdd20003eb0 2021-03-09T09:56:12.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:12.991+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:56:12.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:12.991+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:56:12.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:12.991+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:56:13.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:13.195+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:56:13.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:13.195+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:56:13.599 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:13.599+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:56:13.599 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:13.599+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:56:14.403 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:14.403+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:56:14.404 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:14.403+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:56:16.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:16.007+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:56:16.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:16.007+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:56:17.541 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:56:17.539+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:56:17.541 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:17.539+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:56:17.542 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:17.539+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:56:17.542 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:17.539+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3037 cs=1 l=1).handle_message read tag failed 2021-03-09T09:56:17.542 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:17.539+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3037 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:56:19.211 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:19.211+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:56:19.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:19.211+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:56:22.541 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:56:22.539+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:56:25.618 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:25.615+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:56:25.618 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:25.615+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:56:27.541 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:56:27.539+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:56:32.541 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:56:32.539+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:56:37.542 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:56:37.538+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:56:38.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:38.430+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:56:38.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:38.430+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:56:42.542 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:56:42.542+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:56:42.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:42.990+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:56:42.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:42.990+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:56:42.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:42.990+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:56:42.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:42.990+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200089f0 2021-03-09T09:56:42.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:42.990+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T09:56:42.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:42.990+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005200 con 0x7fdd20006b10 2021-03-09T09:56:42.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:42.990+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:56:42.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:42.990+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:56:43.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:43.194+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:56:43.196 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:43.194+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:56:43.599 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:43.598+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:56:43.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:43.598+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:56:44.403 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:44.402+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:56:44.404 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:44.402+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:56:46.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:46.006+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:56:46.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:46.006+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:56:47.542 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:56:47.538+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:56:47.543 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:47.538+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:56:47.543 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:47.538+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:56:47.543 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:47.538+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3054 cs=1 l=1).handle_message read tag failed 2021-03-09T09:56:47.544 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:47.538+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3054 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:56:49.211 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:49.210+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:56:49.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:49.210+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:56:52.543 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:56:52.538+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:56:55.618 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:55.618+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:56:55.618 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:56:55.618+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:56:57.543 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:56:57.542+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:57:02.543 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:57:02.538+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:57:07.543 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:57:07.542+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:57:08.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:08.430+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:57:08.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:08.430+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:57:12.543 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:57:12.541+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:57:12.993 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:12.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:57:12.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:12.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:57:12.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:12.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:57:12.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:12.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd200089f0 2021-03-09T09:57:12.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:12.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200032a0 2021-03-09T09:57:12.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:12.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T09:57:12.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:12.993+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:57:12.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:12.993+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:57:13.199 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:13.197+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:57:13.200 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:13.197+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:57:13.603 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:13.601+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:57:13.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:13.601+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:57:14.407 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:14.405+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:57:14.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:14.405+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:57:16.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:16.009+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:57:16.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:16.009+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:57:17.544 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:57:17.541+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:57:17.544 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:17.541+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:57:17.544 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:17.541+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:57:17.545 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:17.541+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3071 cs=1 l=1).handle_message read tag failed 2021-03-09T09:57:17.545 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:17.541+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3071 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:57:19.213 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:19.213+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:57:19.214 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:19.213+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:57:22.544 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:57:22.541+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:57:25.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:25.617+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:57:25.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:25.617+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:57:27.544 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:57:27.541+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:57:32.544 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:57:32.545+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:57:37.544 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:57:37.541+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:57:38.433 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:38.429+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:57:38.433 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:38.429+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:57:42.545 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:57:42.541+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:57:42.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:42.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:57:42.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:42.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:57:42.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:42.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:57:42.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:42.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd200089f0 2021-03-09T09:57:42.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:42.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:57:42.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:42.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:57:42.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:42.993+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:57:42.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:42.993+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:57:43.198 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:43.197+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:57:43.199 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:43.197+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:57:43.603 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:43.601+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:57:43.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:43.601+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:57:44.407 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:44.405+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:57:44.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:44.405+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:57:46.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:46.009+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:57:46.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:46.009+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:57:47.545 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:57:47.545+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:57:47.546 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:47.545+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:57:47.546 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:47.545+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:57:47.547 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:47.545+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3088 cs=1 l=1).handle_message read tag failed 2021-03-09T09:57:47.547 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:47.545+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3088 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:57:49.213 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:49.212+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:57:49.214 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:49.212+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:57:52.545 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:57:52.544+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:57:55.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:55.620+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:57:55.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:57:55.620+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:57:57.545 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:57:57.540+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:58:02.546 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:58:02.540+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:58:07.546 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:58:07.544+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:58:08.423 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:08.424+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:58:08.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:08.424+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:58:12.546 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:58:12.544+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:58:12.994 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:12.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:58:12.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:12.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:58:12.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:12.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:58:12.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:12.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200089f0 2021-03-09T09:58:12.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:12.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20008610 2021-03-09T09:58:12.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:12.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T09:58:12.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:12.992+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:58:12.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:12.992+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:58:13.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:13.196+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:58:13.196 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:13.196+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:58:13.599 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:13.600+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:58:13.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:13.600+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:58:14.404 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:14.404+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:58:14.404 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:14.404+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:58:16.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:16.008+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:58:16.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:16.008+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:58:17.546 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:58:17.544+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:58:17.547 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:17.544+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T09:58:17.548 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:17.544+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:58:17.548 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:17.544+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3105 cs=1 l=1).handle_message read tag failed 2021-03-09T09:58:17.548 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:17.544+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3105 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:58:19.211 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:19.212+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:58:19.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:19.212+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:58:22.546 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:58:22.543+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:58:25.618 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:25.615+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:58:25.619 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:25.615+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:58:27.547 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:58:27.543+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:58:32.547 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:58:32.543+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:58:37.547 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:58:37.547+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:58:38.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:38.431+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:58:38.433 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:38.431+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:58:42.548 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:58:42.547+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:58:42.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:42.991+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:58:42.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:42.991+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:58:42.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:42.991+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200089f0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:58:42.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:42.991+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T09:58:42.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:42.991+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T09:58:42.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:42.991+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T09:58:42.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:42.991+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:58:42.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:42.991+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:58:43.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:43.195+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:58:43.196 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:43.195+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:58:43.599 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:43.599+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:58:43.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:43.599+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:58:44.403 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:44.403+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:58:44.404 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:44.403+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:58:46.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:46.007+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:58:46.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:46.007+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:58:47.548 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:58:47.547+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:58:47.549 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:47.547+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:58:47.549 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:47.547+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:58:47.549 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:47.547+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3126 cs=1 l=1).handle_message read tag failed 2021-03-09T09:58:47.550 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:47.547+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3126 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:58:49.211 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:49.211+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:58:49.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:49.211+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:58:52.548 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:58:52.547+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:58:55.618 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:55.619+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:58:55.619 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:58:55.619+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:58:57.549 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:58:57.546+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:59:02.549 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:59:02.546+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:59:07.549 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:59:07.546+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:59:08.425 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:08.422+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:59:08.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:08.426+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:59:12.550 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:59:12.550+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:59:12.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:12.990+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:59:12.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:12.990+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:59:12.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:12.990+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:59:12.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:12.990+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T09:59:12.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:12.990+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200103e0 2021-03-09T09:59:12.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:12.990+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T09:59:12.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:12.990+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:59:12.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:12.990+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:59:13.195 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:13.194+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:59:13.196 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:13.194+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:59:13.599 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:13.598+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:59:13.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:13.598+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:59:14.403 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:14.402+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:59:14.404 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:14.402+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:59:16.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:16.006+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:59:16.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:16.006+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:59:17.550 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:17.550+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T09:59:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:17.550+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:59:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:17.550+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3163 cs=1 l=1).handle_message read tag failed 2021-03-09T09:59:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:17.550+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3163 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:59:17.552 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:59:17.550+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:59:19.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:19.210+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:59:19.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:19.210+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:59:22.550 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:59:22.546+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:59:25.618 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:25.618+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:59:25.619 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:25.618+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:59:27.551 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:59:27.546+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:59:32.551 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:59:32.545+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:59:37.551 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:59:37.545+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:59:38.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:38.429+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:59:38.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:38.429+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:59:42.551 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:59:42.549+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:59:42.995 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:42.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T09:59:42.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:42.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:59:42.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:42.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T09:59:42.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:42.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20003eb0 2021-03-09T09:59:42.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:42.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd200103e0 2021-03-09T09:59:42.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:42.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T09:59:42.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:42.993+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:59:42.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:42.993+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:59:43.199 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:43.197+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:59:43.200 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:43.197+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:59:43.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:43.601+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:59:43.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:43.601+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:59:44.407 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:44.405+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:59:44.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:44.405+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:59:46.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:46.009+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:59:46.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:46.009+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:59:47.552 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:59:47.549+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:59:47.553 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:47.549+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T09:59:47.553 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:47.549+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T09:59:47.554 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:47.549+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3200 cs=1 l=1).handle_message read tag failed 2021-03-09T09:59:47.554 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:47.549+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3200 cs=1 l=1).fault on lossy channel, failing 2021-03-09T09:59:49.213 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:49.213+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:59:49.214 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:49.213+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:59:52.552 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:59:52.549+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T09:59:55.619 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:55.617+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T09:59:55.621 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T09:59:55.617+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T09:59:57.552 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T09:59:57.549+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:00:02.553 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:00:02.553+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:00:07.553 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:00:07.552+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:00:08.433 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:08.432+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:00:08.433 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:08.432+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:00:12.553 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:00:12.552+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:00:12.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:12.988+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:00:12.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:12.988+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:00:12.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:12.988+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:00:12.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:12.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:00:12.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:12.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd200103e0 2021-03-09T10:00:12.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:12.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T10:00:12.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:12.992+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:00:12.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:12.992+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:00:13.200 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:13.196+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:00:13.200 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:13.196+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:00:13.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:13.600+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:00:13.605 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:13.600+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:00:14.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:14.404+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:00:14.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:14.404+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:00:16.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:16.008+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:00:16.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:16.008+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:00:17.553 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:00:17.552+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:00:17.554 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:17.552+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:00:17.555 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:17.552+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:00:17.555 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:17.552+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3233 cs=1 l=1).handle_message read tag failed 2021-03-09T10:00:17.555 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:17.552+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3233 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:00:19.214 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:19.212+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:00:19.215 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:19.212+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:00:22.554 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:00:22.548+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:00:25.618 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:25.616+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:00:25.618 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:25.616+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:00:27.554 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:00:27.552+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:00:32.554 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:00:32.552+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:00:37.554 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:00:37.552+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:00:38.430 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:38.428+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:00:38.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:38.428+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:00:42.555 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:00:42.551+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:00:42.996 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:42.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:00:42.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:42.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:00:42.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:42.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:00:42.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:42.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:00:42.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:42.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T10:00:42.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:42.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:00:42.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:42.995+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:00:42.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:42.995+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:00:43.199 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:43.199+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:00:43.200 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:43.199+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:00:43.603 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:43.603+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:00:43.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:43.603+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:00:44.407 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:44.407+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:00:44.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:44.407+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:00:46.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:46.011+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:00:46.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:46.011+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:00:47.555 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:00:47.551+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:00:47.556 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:47.551+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:00:47.556 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:47.551+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:00:47.557 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:47.551+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3250 cs=1 l=1).handle_message read tag failed 2021-03-09T10:00:47.557 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:47.551+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3250 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:00:49.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:49.215+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:00:49.217 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:49.215+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:00:52.555 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:00:52.555+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:00:55.622 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:55.619+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:00:55.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:00:55.623+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:00:57.555 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:00:57.555+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:01:02.556 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:01:02.555+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:01:07.556 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:01:07.555+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:01:08.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:08.435+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:01:08.437 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:08.435+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:01:12.556 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:01:12.555+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:01:12.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:12.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:01:12.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:12.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:01:12.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:12.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:01:12.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:12.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20008610 2021-03-09T10:01:12.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:12.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200032a0 2021-03-09T10:01:12.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:12.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:01:12.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:12.995+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20016840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:01:12.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:12.995+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:01:13.200 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:13.199+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20016840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:01:13.200 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:13.199+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:01:13.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:13.603+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20016840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:01:13.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:13.603+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:01:14.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:14.407+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20016840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:01:14.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:14.407+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:01:16.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:16.011+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20016840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:01:16.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:16.011+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:01:17.556 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:01:17.555+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:01:17.557 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:17.555+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:01:17.557 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:17.555+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:01:17.557 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:17.555+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3267 cs=1 l=1).handle_message read tag failed 2021-03-09T10:01:17.558 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:17.555+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3267 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:01:19.214 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:19.214+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20016840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:01:19.215 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:19.214+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:01:22.557 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:01:22.554+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:01:25.621 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:25.618+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20016840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:01:25.622 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:25.618+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:01:27.557 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:01:27.554+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:01:32.557 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:01:32.554+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:01:37.557 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:01:37.554+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:01:38.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:38.430+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20016840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:01:38.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:38.430+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:01:42.557 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:01:42.554+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:01:42.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:42.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:01:42.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:42.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:01:42.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:42.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20016840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:01:42.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:42.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20008610 2021-03-09T10:01:42.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:42.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd200032a0 2021-03-09T10:01:42.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:42.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:01:42.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:42.994+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:01:42.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:42.994+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:01:43.200 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:43.198+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:01:43.200 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:43.198+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:01:43.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:43.602+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:01:43.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:43.602+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:01:44.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:44.406+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:01:44.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:44.406+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:01:46.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:46.010+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:01:46.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:46.010+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:01:47.558 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:01:47.558+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:01:47.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:47.558+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:01:47.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:47.558+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:01:47.559 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:47.558+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3284 cs=1 l=1).handle_message read tag failed 2021-03-09T10:01:47.560 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:47.558+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3284 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:01:49.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:49.214+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:01:49.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:49.214+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:01:52.558 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:01:52.554+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:01:55.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:55.617+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:01:55.621 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:01:55.617+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:01:57.558 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:01:57.553+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:02:02.558 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:02:02.553+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:02:07.559 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:02:07.553+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:02:08.433 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:08.429+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:02:08.434 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:08.429+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:02:12.559 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:02:12.557+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:02:12.997 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:12.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:02:12.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:12.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:02:12.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:12.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20008610 legacy=0x7fdd20006ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:02:12.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:12.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:02:12.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:12.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd200032a0 2021-03-09T10:02:12.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:12.993+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T10:02:12.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:12.993+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:02:12.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:12.993+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:02:13.200 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:13.197+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:02:13.200 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:13.197+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:02:13.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:13.601+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:02:13.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:13.601+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:02:14.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:14.405+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:02:14.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:14.405+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:02:16.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:16.009+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:02:16.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:16.009+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:02:17.559 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:02:17.553+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:02:17.561 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:17.553+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:02:17.561 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:17.553+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:02:17.562 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:17.553+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3301 cs=1 l=1).handle_message read tag failed 2021-03-09T10:02:17.562 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:17.553+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3301 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:02:19.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:19.213+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:02:19.217 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:19.213+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:02:22.559 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:02:22.557+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:02:25.622 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:25.621+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:02:25.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:25.621+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:02:27.559 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:02:27.557+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:02:32.560 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:02:32.556+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:02:37.560 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:02:37.556+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:02:38.433 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:38.432+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:02:38.434 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:38.432+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:02:42.560 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:02:42.556+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:02:42.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:42.996+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:02:42.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:42.996+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:02:42.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:42.996+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:02:42.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:42.996+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:02:42.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:42.996+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000a7b0 2021-03-09T10:02:42.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:42.996+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:02:42.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:42.996+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:02:43.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:42.996+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000a7b0 legacy=0x7fdd2000ab90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:02:43.204 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:43.200+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:02:43.204 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:43.200+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000a7b0 legacy=0x7fdd2000ab90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:02:43.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:43.604+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:02:43.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:43.604+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000a7b0 legacy=0x7fdd2000ab90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:02:44.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:44.408+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:02:44.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:44.408+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000a7b0 legacy=0x7fdd2000ab90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:02:46.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:46.012+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:02:46.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:46.012+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000a7b0 legacy=0x7fdd2000ab90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:02:47.560 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:02:47.560+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:02:47.561 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:47.560+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:02:47.562 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:47.560+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:02:47.562 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:47.560+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3318 cs=1 l=1).handle_message read tag failed 2021-03-09T10:02:47.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:47.560+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3318 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:02:49.218 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:49.216+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:02:49.219 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:49.216+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000a7b0 legacy=0x7fdd2000ab90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:02:52.561 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:02:52.560+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:02:55.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:55.624+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:02:55.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:02:55.624+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000a7b0 legacy=0x7fdd2000ab90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:02:57.561 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:02:57.560+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:03:02.561 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:03:02.560+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:03:07.561 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:03:07.559+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:03:08.437 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:08.435+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:03:08.438 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:08.435+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000a7b0 legacy=0x7fdd2000ab90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:03:12.561 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:03:12.559+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:03:12.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:12.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:03:12.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:12.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000a7b0 legacy=0x7fdd2000ab90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:03:12.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:12.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:03:12.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:12.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd2000c2b0 2021-03-09T10:03:12.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:12.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200032a0 2021-03-09T10:03:13.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:12.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:03:13.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:12.995+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:03:13.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:12.995+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:03:13.200 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:13.199+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:03:13.200 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:13.199+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:03:13.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:13.603+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:03:13.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:13.603+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:03:14.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:14.407+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:03:14.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:14.407+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:03:16.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:16.011+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:03:16.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:16.011+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:03:17.562 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:03:17.559+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:03:17.563 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:17.559+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:03:17.564 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:17.559+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:03:17.564 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:17.559+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3335 cs=1 l=1).handle_message read tag failed 2021-03-09T10:03:17.565 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:17.559+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3335 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:03:19.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:19.215+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:03:19.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:19.215+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:03:22.562 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:03:22.559+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:03:25.622 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:25.619+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:03:25.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:25.619+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:03:27.562 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:03:27.559+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:03:32.562 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:03:32.559+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:03:37.562 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:03:37.559+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:03:38.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:38.435+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:03:38.436 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:38.435+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:03:42.563 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:03:42.563+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:03:42.998 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:42.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:03:42.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:42.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:03:42.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:42.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:03:42.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:42.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd2000c2b0 2021-03-09T10:03:42.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:42.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd200032a0 2021-03-09T10:03:43.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:42.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:03:43.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:42.994+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:03:43.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:42.994+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:03:43.198 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:43.198+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:03:43.199 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:43.198+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:03:43.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:43.602+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:03:43.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:43.602+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:03:44.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:44.406+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:03:44.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:44.406+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:03:46.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:46.010+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:03:46.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:46.010+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:03:47.563 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:03:47.558+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:03:47.564 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:47.558+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:03:47.564 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:47.558+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:03:47.564 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:47.558+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3352 cs=1 l=1).handle_message read tag failed 2021-03-09T10:03:47.564 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:47.558+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3352 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:03:49.218 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:49.214+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:03:49.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:49.214+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:03:52.563 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:03:52.562+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:03:55.622 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:55.618+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:03:55.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:03:55.622+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:03:57.563 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:03:57.558+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:04:02.564 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:04:02.562+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:04:07.564 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:04:07.562+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:04:08.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:08.430+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:04:08.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:08.430+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:04:12.564 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:04:12.562+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:04:12.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:12.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:04:12.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:12.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:04:12.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:12.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:04:13.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:12.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000c2b0 2021-03-09T10:04:13.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:12.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd200032a0 2021-03-09T10:04:13.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:12.994+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T10:04:13.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:12.994+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:04:13.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:12.994+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:04:13.199 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:13.198+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:04:13.200 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:13.198+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:04:13.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:13.602+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:04:13.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:13.602+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:04:14.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:14.406+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:04:14.408 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:14.406+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:04:16.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:16.010+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:04:16.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:16.010+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:04:17.564 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:04:17.562+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:04:17.565 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:17.562+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:04:17.565 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:17.562+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:04:17.565 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:17.562+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3369 cs=1 l=1).handle_message read tag failed 2021-03-09T10:04:17.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:17.562+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3369 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:04:19.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:19.214+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:04:19.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:19.214+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:04:22.564 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:04:22.561+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:04:25.622 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:25.621+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:04:25.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:25.621+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:04:27.564 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:04:27.561+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:04:32.565 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:04:32.561+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:04:37.565 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:04:37.565+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:04:38.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:38.425+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:04:38.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:38.429+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:04:42.565 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:04:42.565+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:04:42.999 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:42.997+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:04:43.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:42.997+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:04:43.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:42.997+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:04:43.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:42.997+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000c2b0 2021-03-09T10:04:43.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:42.997+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T10:04:43.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:42.997+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:04:43.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:42.997+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:04:43.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:42.997+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:04:43.204 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:43.201+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:04:43.204 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:43.201+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:04:43.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:43.605+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:04:43.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:43.605+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:04:44.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:44.409+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:04:44.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:44.409+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:04:46.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:46.013+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:04:46.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:46.013+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:04:47.565 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:04:47.565+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:04:47.566 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:47.565+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:04:47.567 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:47.565+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:04:47.567 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:47.565+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3386 cs=1 l=1).handle_message read tag failed 2021-03-09T10:04:47.567 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:47.565+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3386 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:04:49.218 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:49.217+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:04:49.218 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:49.217+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:04:52.566 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:04:52.565+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:04:55.625 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:55.625+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:04:55.625 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:04:55.625+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:04:57.566 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:04:57.564+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:05:02.566 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:05:02.564+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:05:07.566 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:05:07.560+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:05:08.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:08.428+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:05:08.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:08.428+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:05:12.567 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:05:12.564+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:05:13.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:12.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:05:13.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:12.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:05:13.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:12.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:05:13.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:12.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T10:05:13.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:12.992+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:05:13.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:12.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200032a0 2021-03-09T10:05:13.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:12.992+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:05:13.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:12.992+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:05:13.196 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:13.196+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:05:13.200 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:13.196+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:05:13.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:13.600+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:05:13.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:13.600+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:05:14.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:14.404+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:05:14.405 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:14.404+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:05:16.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:16.008+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:05:16.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:16.008+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:05:17.567 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:05:17.564+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:05:17.568 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:17.564+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:05:17.568 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:17.564+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:05:17.568 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:17.564+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3403 cs=1 l=1).handle_message read tag failed 2021-03-09T10:05:17.569 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:17.564+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3403 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:05:19.213 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:19.212+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:05:19.215 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:19.212+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:05:22.567 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:05:22.564+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:05:25.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:25.620+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:05:25.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:25.620+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:05:27.567 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:05:27.564+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:05:32.568 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:05:32.568+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:05:37.568 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:05:37.567+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:05:38.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:38.423+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:05:38.433 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:38.431+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:05:42.568 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:05:42.567+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:05:43.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:42.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:05:43.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:42.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:05:43.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:42.995+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:05:43.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:42.999+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20003eb0 2021-03-09T10:05:43.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:42.999+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd200032a0 2021-03-09T10:05:43.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:42.999+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:05:43.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:42.999+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:05:43.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:42.999+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:05:43.204 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:43.203+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:05:43.204 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:43.203+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:05:43.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:43.607+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:05:43.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:43.607+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:05:44.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:44.411+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:05:44.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:44.411+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:05:46.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:46.015+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:05:46.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:46.015+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:05:47.568 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:05:47.567+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:05:47.569 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:47.567+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:05:47.569 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:47.567+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:05:47.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:47.567+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3420 cs=1 l=1).handle_message read tag failed 2021-03-09T10:05:47.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:47.567+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3420 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:05:49.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:49.219+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:05:49.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:49.219+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:05:52.568 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:05:52.567+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:05:55.626 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:55.623+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:05:55.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:05:55.623+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:05:57.569 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:05:57.567+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:06:02.569 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:06:02.567+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:06:07.569 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:06:07.567+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:06:08.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:08.435+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:06:08.440 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:08.439+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:06:12.569 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:06:12.566+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:06:13.000 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:12.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:06:13.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:12.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:06:13.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:12.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:06:13.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:12.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:06:13.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:12.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd200032a0 2021-03-09T10:06:13.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:12.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T10:06:13.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:12.998+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:06:13.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:12.998+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:06:13.204 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:13.202+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:06:13.204 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:13.202+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:06:13.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:13.606+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:06:13.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:13.606+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:06:14.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:14.410+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:06:14.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:14.410+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:06:16.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:16.014+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:06:16.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:16.014+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:06:17.569 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:06:17.566+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:06:17.570 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:17.566+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:06:17.571 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:17.566+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:06:17.571 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:17.566+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3437 cs=1 l=1).handle_message read tag failed 2021-03-09T10:06:17.571 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:17.566+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3437 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:06:19.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:19.218+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:06:19.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:19.218+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:06:22.570 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:06:22.566+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:06:25.626 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:25.622+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:06:25.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:25.622+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:06:27.570 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:06:27.570+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:06:32.570 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:06:32.566+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:06:37.570 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:06:37.570+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:06:38.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:38.434+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:06:38.440 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:38.438+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:06:42.570 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:06:42.570+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:06:43.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:42.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:06:43.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:42.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:06:43.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:42.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:06:43.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:42.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:06:43.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:42.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000bed0 2021-03-09T10:06:43.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:42.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:06:43.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:42.998+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:06:43.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:42.998+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:06:43.204 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:43.202+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:06:43.204 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:43.202+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:06:43.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:43.606+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:06:43.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:43.606+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:06:44.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:44.410+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:06:44.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:44.410+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:06:46.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:46.014+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:06:46.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:46.014+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:06:47.571 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:06:47.569+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:06:47.571 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:47.569+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:06:47.572 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:47.569+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:06:47.572 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:47.569+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3454 cs=1 l=1).handle_message read tag failed 2021-03-09T10:06:47.572 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:47.569+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3454 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:06:49.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:49.217+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:06:49.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:49.217+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:06:52.571 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:06:52.565+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:06:55.621 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:55.621+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:06:55.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:06:55.621+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:06:57.571 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:06:57.569+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:07:02.571 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:07:02.565+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:07:07.571 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:07:07.569+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:07:08.425 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:08.425+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:07:08.437 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:08.433+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:07:12.572 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:07:12.569+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:07:13.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:13.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:07:13.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:13.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:07:13.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:13.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:07:13.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:13.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd2000c2b0 2021-03-09T10:07:13.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:13.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000bed0 2021-03-09T10:07:13.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:13.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:07:13.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:13.001+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:07:13.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:13.001+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:07:13.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:13.205+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:07:13.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:13.205+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:07:13.612 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:13.609+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:07:13.612 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:13.609+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:07:14.413 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:14.413+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:07:14.413 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:14.413+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:07:16.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:16.017+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:07:16.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:16.017+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:07:17.572 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:07:17.569+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:07:17.573 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:17.569+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:07:17.573 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:17.569+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:07:17.573 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:17.569+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3471 cs=1 l=1).handle_message read tag failed 2021-03-09T10:07:17.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:17.569+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3471 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:07:19.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:19.221+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:07:19.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:19.221+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:07:22.572 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:07:22.569+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:07:25.630 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:25.624+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:07:25.630 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:25.624+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:07:27.572 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:07:27.572+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:07:32.573 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:07:32.572+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:07:37.573 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:07:37.568+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:07:38.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:38.428+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:07:38.433 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:38.428+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:07:42.573 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:07:42.572+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:07:43.001 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:43.000+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:07:43.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:43.000+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:07:43.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:43.000+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:07:43.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:43.000+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd2000c2b0 2021-03-09T10:07:43.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:43.000+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd2000bed0 2021-03-09T10:07:43.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:43.000+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:07:43.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:43.000+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:07:43.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:43.000+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:07:43.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:43.204+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:07:43.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:43.204+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:07:43.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:43.608+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:07:43.609 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:43.608+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:07:44.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:44.412+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:07:44.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:44.412+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:07:46.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:46.016+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:07:46.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:46.016+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:07:47.573 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:47.572+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:07:47.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:47.572+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:07:47.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:47.572+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3488 cs=1 l=1).handle_message read tag failed 2021-03-09T10:07:47.574 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:47.572+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3488 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:07:47.575 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:07:47.572+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:07:49.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:49.220+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:07:49.221 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:49.220+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:07:52.574 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:07:52.572+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:07:55.626 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:55.624+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:07:55.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:07:55.624+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:07:57.574 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:07:57.572+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:08:02.574 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:08:02.571+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:08:07.574 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:08:07.571+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:08:08.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:08.431+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:08:08.436 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:08.435+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:08:12.574 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:08:12.571+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:08:13.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:12.999+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:08:13.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:12.999+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:08:13.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:12.999+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:08:13.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:12.999+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000c2b0 2021-03-09T10:08:13.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:12.999+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20003eb0 2021-03-09T10:08:13.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:12.999+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T10:08:13.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:12.999+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:08:13.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:12.999+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:08:13.204 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:13.203+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:08:13.204 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:13.203+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:08:13.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:13.607+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:08:13.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:13.607+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:08:14.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:14.411+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:08:14.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:14.411+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:08:16.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:16.015+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:08:16.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:16.015+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:08:17.577 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:08:17.571+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:08:17.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:17.571+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:08:17.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:17.571+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:08:17.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:17.571+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3505 cs=1 l=1).handle_message read tag failed 2021-03-09T10:08:17.579 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:17.571+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3505 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:08:19.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:19.219+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:08:19.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:19.219+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:08:22.575 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:08:22.575+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:08:25.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:25.623+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:08:25.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:25.623+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:08:27.575 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:08:27.571+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:08:32.575 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:08:32.571+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:08:37.576 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:08:37.575+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:08:38.437 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:38.435+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:08:38.438 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:38.435+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:08:42.576 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:08:42.574+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:08:43.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:42.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:08:43.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:42.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:08:43.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:42.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:08:43.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:42.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000bed0 2021-03-09T10:08:43.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:42.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T10:08:43.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:42.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:08:43.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:42.998+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:08:43.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:42.998+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:08:43.202 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:43.202+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:08:43.203 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:43.202+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:08:43.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:43.606+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:08:43.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:43.606+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:08:44.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:44.410+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:08:44.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:44.410+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:08:46.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:46.014+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:08:46.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:46.014+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:08:47.576 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:08:47.574+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:08:47.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:47.574+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:08:47.577 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:47.574+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:08:47.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:47.574+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3522 cs=1 l=1).handle_message read tag failed 2021-03-09T10:08:47.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:47.574+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3522 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:08:49.219 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:49.218+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:08:49.219 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:49.218+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:08:52.576 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:08:52.574+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:08:55.625 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:55.622+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:08:55.626 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:08:55.622+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:08:57.577 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:08:57.574+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:09:02.577 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:09:02.574+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:09:07.577 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:09:07.574+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:09:08.438 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:08.438+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:09:08.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:08.438+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:09:12.577 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:09:12.574+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:09:13.002 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:13.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:09:13.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:13.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:09:13.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:13.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:09:13.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:13.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20003eb0 2021-03-09T10:09:13.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:13.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200032a0 2021-03-09T10:09:13.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:13.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:09:13.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:13.002+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:09:13.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:13.002+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:09:13.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:13.206+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:09:13.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:13.206+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:09:13.612 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:13.610+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:09:13.612 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:13.610+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:09:14.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:14.414+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:09:14.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:14.414+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:09:16.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:16.018+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:09:16.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:16.018+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:09:17.577 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:09:17.577+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:09:17.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:17.577+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:09:17.578 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:17.577+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:09:17.579 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:17.577+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3539 cs=1 l=1).handle_message read tag failed 2021-03-09T10:09:17.579 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:17.577+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3539 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:09:19.224 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:19.221+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:09:19.224 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:19.221+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:09:22.578 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:09:22.577+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:09:25.630 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:25.625+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:09:25.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:25.625+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:09:27.578 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:09:27.577+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:09:32.578 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:09:32.577+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:09:37.578 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:09:37.573+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:09:38.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:38.429+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:09:38.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:38.437+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:09:42.578 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:09:42.577+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:09:43.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:42.997+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:09:43.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:42.997+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:09:43.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:42.997+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:09:43.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:42.997+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20003eb0 2021-03-09T10:09:43.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:42.997+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd200032a0 2021-03-09T10:09:43.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:42.997+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:09:43.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:42.997+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:09:43.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:42.997+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:09:43.203 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:43.201+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:09:43.204 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:43.201+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:09:43.607 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:43.605+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:09:43.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:43.605+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:09:44.409 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:44.409+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:09:44.409 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:44.409+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:09:46.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:46.013+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:09:46.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:46.013+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:09:47.579 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:09:47.577+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:09:47.580 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:47.577+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:09:47.580 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:47.577+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:09:47.580 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:47.577+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3556 cs=1 l=1).handle_message read tag failed 2021-03-09T10:09:47.580 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:47.577+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3556 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:09:49.217 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:49.217+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:09:49.219 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:49.217+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:09:52.579 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:09:52.577+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:09:55.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:55.620+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:09:55.625 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:09:55.620+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:09:57.579 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:09:57.576+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:10:02.580 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:10:02.576+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:10:07.580 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:10:07.576+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:10:08.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:08.424+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:10:08.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:08.424+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:10:12.580 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:10:12.580+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:10:13.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:13.000+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:10:13.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:13.000+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:10:13.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:13.000+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:10:13.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:13.000+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000c2b0 2021-03-09T10:10:13.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:13.000+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd200032a0 2021-03-09T10:10:13.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:13.000+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200047b0 con 0x7fdd20006b10 2021-03-09T10:10:13.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:13.000+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:10:13.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:13.000+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:10:13.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:13.204+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:10:13.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:13.204+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:10:13.612 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:13.608+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:10:13.612 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:13.608+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:10:14.413 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:14.412+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:10:14.413 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:14.412+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:10:16.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:16.016+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:10:16.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:16.016+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:10:17.581 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:10:17.580+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:10:17.581 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:17.580+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:10:17.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:17.580+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:10:17.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:17.580+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3577 cs=1 l=1).handle_message read tag failed 2021-03-09T10:10:17.582 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:17.580+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3577 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:10:19.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:19.220+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:10:19.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:19.220+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:10:22.581 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:10:22.580+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:10:25.625 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:25.624+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:10:25.625 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:25.624+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:10:27.581 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:10:27.580+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:10:32.582 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:10:32.580+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:10:37.582 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:10:37.579+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:10:38.438 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:38.435+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:10:38.438 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:38.435+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:10:39.104 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:39.103+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd2406cfc0 legacy=0x7fdd2406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-03-09T10:10:39.104 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:39.103+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd2406cfc0 legacy=0x7fdd2406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:10:39.104 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:39.103+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd2406cfc0 0x7fdd2406c7f0 :-1 s=OPENED pgs=101 cs=1 l=1).handle_message read tag failed 2021-03-09T10:10:39.105 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:39.103+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd2406cfc0 0x7fdd2406c7f0 :-1 s=OPENED pgs=101 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:10:39.105 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:39.103+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd2406cfc0 legacy=0x7fdd2406c7f0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting, fault. 2021-03-09T10:10:39.105 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:39.103+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd2406cfc0 legacy=0x7fdd2406c7f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:10:42.582 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:10:42.579+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:10:43.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:42.999+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:10:43.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:42.999+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:10:43.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:42.999+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:10:43.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:42.999+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:10:43.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:42.999+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000bed0 2021-03-09T10:10:43.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:42.999+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:10:43.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:43.003+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:10:43.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:43.003+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:10:43.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:43.207+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:10:43.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:43.207+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:10:43.611 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:43.611+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:10:43.612 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:43.611+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:10:44.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:44.415+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:10:44.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:44.415+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:10:46.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:46.019+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:10:46.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:46.019+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:10:47.583 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:10:47.579+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:10:47.583 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:47.579+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:10:47.584 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:47.579+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:10:47.584 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:47.579+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3614 cs=1 l=1).handle_message read tag failed 2021-03-09T10:10:47.584 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:47.579+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3614 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:10:49.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:49.223+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:10:49.224 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:49.223+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:10:52.583 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:10:52.579+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:10:55.630 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:55.627+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:10:55.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:10:55.627+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:10:57.583 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:10:57.583+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:11:02.583 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:11:02.583+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:11:07.584 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:11:07.583+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:11:08.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:08.443+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:11:08.444 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:08.443+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:11:12.584 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:11:12.582+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:11:13.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:12.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:11:13.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:12.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2001bf80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:11:13.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:12.998+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:11:13.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:13.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd200032a0 2021-03-09T10:11:13.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:13.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000bed0 2021-03-09T10:11:13.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:13.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:11:13.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:13.002+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:11:13.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:13.002+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:11:13.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:13.206+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:11:13.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:13.206+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:11:13.611 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:13.610+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:11:13.612 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:13.610+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:11:14.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:14.414+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:11:14.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:14.414+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:11:16.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:16.018+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:11:16.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:16.018+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:11:17.585 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:11:17.582+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:11:17.585 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:17.582+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:11:17.585 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:17.582+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:11:17.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:17.582+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3651 cs=1 l=1).handle_message read tag failed 2021-03-09T10:11:17.586 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:17.582+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3651 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:11:19.222 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:19.222+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:11:19.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:19.222+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:11:22.585 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:11:22.582+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:11:25.628 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:25.626+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:11:25.629 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:25.626+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:11:27.585 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:11:27.582+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:11:32.585 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:11:32.582+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:11:37.585 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:11:37.586+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:11:38.441 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:38.438+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:11:38.442 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:38.438+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:11:42.586 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:11:42.586+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:11:43.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:43.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:11:43.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:43.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:11:43.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:43.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:11:43.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:43.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd200032a0 2021-03-09T10:11:43.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:43.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd2000bed0 2021-03-09T10:11:43.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:43.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:11:43.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:43.002+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:11:43.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:43.002+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:11:43.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:43.206+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:11:43.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:43.206+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:11:43.611 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:43.610+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:11:43.612 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:43.610+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:11:44.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:44.414+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:11:44.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:44.414+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:11:46.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:46.018+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:11:46.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:46.018+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:11:47.586 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:11:47.582+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:11:47.587 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:47.582+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:11:47.587 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:47.582+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:11:47.587 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:47.582+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3684 cs=1 l=1).handle_message read tag failed 2021-03-09T10:11:47.587 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:47.582+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3684 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:11:49.224 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:49.221+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:11:49.224 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:49.221+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:11:52.586 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:11:52.585+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:11:55.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:55.625+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:11:55.630 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:11:55.625+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:11:57.586 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:11:57.585+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:12:02.586 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:12:02.585+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:12:07.587 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:12:07.585+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:12:08.438 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:08.437+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:12:08.440 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:08.437+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:12:12.587 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:12:12.585+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:12:13.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:13.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:12:13.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:13.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:12:13.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:13.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:12:13.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:13.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:12:13.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:13.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd2000bed0 2021-03-09T10:12:13.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:13.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd20006b10 2021-03-09T10:12:13.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:13.001+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:12:13.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:13.001+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:12:13.205 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:13.205+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:12:13.205 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:13.205+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:12:13.610 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:13.609+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:12:13.610 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:13.609+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:12:14.415 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:14.413+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:12:14.415 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:14.413+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:12:16.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:16.017+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:12:16.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:16.017+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:12:17.587 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:12:17.585+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:12:17.588 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:17.585+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:12:17.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:17.585+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:12:17.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:17.585+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3701 cs=1 l=1).handle_message read tag failed 2021-03-09T10:12:17.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:17.585+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3701 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:12:19.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:19.221+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:12:19.221 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:19.221+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:12:22.588 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:12:22.585+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:12:25.628 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:25.625+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:12:25.628 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:25.625+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:12:27.588 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:12:27.588+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:12:32.588 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:12:32.584+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:12:37.588 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:12:37.588+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:12:38.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:38.428+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:12:38.440 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:38.436+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:12:42.588 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:12:42.588+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:12:43.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:43.004+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:12:43.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:43.004+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:12:43.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:43.004+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:12:43.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:43.004+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:12:43.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:43.004+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000c2b0 2021-03-09T10:12:43.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:43.004+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:12:43.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:43.004+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:12:43.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:43.004+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:12:43.209 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:43.208+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:12:43.209 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:43.208+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:12:43.615 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:43.612+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:12:43.616 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:43.612+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:12:44.417 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:44.416+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:12:44.417 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:44.416+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:12:46.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:46.020+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:12:46.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:46.020+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:12:47.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:47.588+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:12:47.589 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:47.588+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:12:47.590 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:12:47.588+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:12:47.590 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:47.588+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3718 cs=1 l=1).handle_message read tag failed 2021-03-09T10:12:47.591 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:47.588+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3718 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:12:49.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:49.224+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:12:49.228 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:49.228+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:12:52.589 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:12:52.588+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:12:55.630 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:55.628+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:12:55.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:12:55.632+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:12:57.589 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:12:57.588+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:13:02.590 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:13:02.588+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:13:07.590 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:13:07.587+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:13:08.440 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:08.439+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:13:08.441 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:08.439+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:13:12.590 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:13:12.587+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:13:13.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:13.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:13:13.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:13.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:13:13.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:13.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:13:13.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:13.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000bed0 con 0x7fdd20003eb0 2021-03-09T10:13:13.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:13.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000c2b0 2021-03-09T10:13:13.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:13.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:13:13.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:13.003+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:13:13.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:13.003+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:13:13.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:13.207+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:13:13.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:13.207+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:13:13.611 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:13.611+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:13:13.612 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:13.611+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:13:14.425 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:14.415+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:13:14.426 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:14.415+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:13:16.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:16.019+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:13:16.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:16.019+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:13:17.590 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:13:17.587+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:13:17.591 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:17.587+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:13:17.591 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:17.587+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:13:17.591 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:17.587+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3735 cs=1 l=1).handle_message read tag failed 2021-03-09T10:13:17.592 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:17.587+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3735 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:13:19.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:19.223+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:13:19.224 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:19.223+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:13:22.591 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:13:22.587+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:13:25.630 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:25.627+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:13:25.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:25.631+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:13:27.591 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:13:27.587+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:13:32.591 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:13:32.587+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:13:37.591 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:13:37.587+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:13:38.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:38.439+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:13:38.444 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:38.443+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:13:42.591 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:13:42.591+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:13:43.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:43.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:13:43.005 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:43.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000c2b0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:13:43.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:43.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:13:43.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:43.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd200103e0 2021-03-09T10:13:43.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:43.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000bed0 con 0x7fdd200032a0 2021-03-09T10:13:43.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:43.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:13:43.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:43.003+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:13:43.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:43.003+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:13:43.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:43.207+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:13:43.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:43.207+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:13:43.611 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:43.610+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:13:43.612 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:43.610+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:13:44.415 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:44.414+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:13:44.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:44.414+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:13:46.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:46.018+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:13:46.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:46.018+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:13:47.592 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:13:47.590+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:13:47.592 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:47.590+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:13:47.593 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:47.590+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:13:47.593 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:47.590+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3752 cs=1 l=1).handle_message read tag failed 2021-03-09T10:13:47.593 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:47.590+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3752 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:13:49.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:49.222+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:13:49.224 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:49.222+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:13:52.592 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:13:52.590+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:13:55.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:55.626+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:13:55.630 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:13:55.626+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:13:57.592 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:13:57.590+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:14:02.592 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:14:02.590+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:14:07.592 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:14:07.590+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:14:08.440 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:08.438+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:14:08.440 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:08.438+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:14:12.593 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:14:12.590+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:14:13.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:13.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:14:13.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:13.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:14:13.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:13.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:14:13.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:13.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200103e0 2021-03-09T10:14:13.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:13.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd200032a0 2021-03-09T10:14:13.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:13.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000bed0 con 0x7fdd20006b10 2021-03-09T10:14:13.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:13.002+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:14:13.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:13.002+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:14:13.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:13.206+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:14:13.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:13.206+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:14:13.611 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:13.610+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:14:13.612 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:13.610+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:14:14.415 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:14.414+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:14:14.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:14.414+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:14:16.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:16.018+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:14:16.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:16.018+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:14:17.593 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:17.590+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:14:17.594 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:17.590+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:14:17.594 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:17.590+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3769 cs=1 l=1).handle_message read tag failed 2021-03-09T10:14:17.594 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:17.590+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3769 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:14:17.595 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:14:17.590+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:14:19.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:19.222+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:14:19.224 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:19.222+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:14:22.593 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:14:22.589+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:14:25.630 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:25.629+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:14:25.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:25.629+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:14:27.594 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:14:27.593+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:14:32.594 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:14:32.593+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:14:37.594 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:14:37.593+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:14:38.441 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:38.437+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:14:38.442 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:38.437+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:14:42.594 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:14:42.589+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:14:43.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:43.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:14:43.006 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:43.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:14:43.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:43.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000c060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:14:43.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:43.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200103e0 2021-03-09T10:14:43.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:43.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:14:43.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:43.001+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:14:43.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:43.001+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:14:43.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:43.001+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:14:43.206 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:43.205+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:14:43.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:43.205+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:14:43.611 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:43.609+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:14:43.612 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:43.609+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:14:44.412 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:44.413+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:14:44.413 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:44.413+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:14:46.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:46.017+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:14:46.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:46.017+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:14:47.594 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:14:47.589+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:14:47.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:47.589+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:14:47.595 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:47.589+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:14:47.596 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:47.589+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000a7b0 :-1 s=OPENED pgs=3786 cs=1 l=1).handle_message read tag failed 2021-03-09T10:14:47.596 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:47.589+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000a7b0 :-1 s=OPENED pgs=3786 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:14:49.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:49.221+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:14:49.224 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:49.221+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:14:52.595 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:14:52.593+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:14:55.630 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:55.629+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:14:55.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:14:55.629+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:14:57.595 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:14:57.593+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:15:02.595 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:15:02.592+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:15:07.595 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:15:07.592+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:15:08.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:08.440+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:15:08.444 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:08.440+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:15:12.595 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:15:12.596+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:15:13.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:13.004+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:15:13.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:13.004+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:15:13.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:13.004+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:15:13.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:13.004+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200107c0 con 0x7fdd200103e0 2021-03-09T10:15:13.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:13.004+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:15:13.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:13.004+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:15:13.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:13.004+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:15:13.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:13.004+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000daa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:15:13.211 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:13.208+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:15:13.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:13.208+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000daa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:15:13.612 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:13.612+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:15:13.613 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:13.612+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000daa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:15:14.419 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:14.416+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:15:14.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:14.416+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000daa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:15:16.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:16.020+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:15:16.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:16.020+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000daa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:15:17.596 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:15:17.596+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:15:17.596 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:17.596+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:15:17.597 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:17.596+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:15:17.597 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:17.596+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000d390 :-1 s=OPENED pgs=3803 cs=1 l=1).handle_message read tag failed 2021-03-09T10:15:17.597 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:17.596+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000d390 :-1 s=OPENED pgs=3803 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:15:19.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:19.224+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:15:19.228 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:19.224+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000daa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:15:22.596 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:15:22.596+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:15:25.634 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:25.632+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:15:25.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:25.632+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000daa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:15:27.596 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:15:27.596+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:15:32.596 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:15:32.596+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:15:37.597 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:15:37.595+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:15:38.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:38.443+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:15:38.444 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:38.443+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000daa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:15:42.597 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:15:42.595+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:15:43.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:43.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000d390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:15:43.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:43.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000daa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:15:43.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:43.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:15:43.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:43.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd200032a0 2021-03-09T10:15:43.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:43.003+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:15:43.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:43.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200107c0 con 0x7fdd20003eb0 2021-03-09T10:15:43.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:43.003+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:15:43.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:43.003+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:15:43.207 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:43.207+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:15:43.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:43.207+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:15:43.611 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:43.611+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:15:43.612 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:43.611+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:15:44.415 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:44.415+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:15:44.416 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:44.415+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:15:46.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:46.019+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:15:46.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:46.019+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:15:47.597 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:15:47.595+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:15:47.598 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:47.595+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:15:47.598 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:47.595+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:15:47.599 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:47.595+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000bed0 :-1 s=OPENED pgs=3820 cs=1 l=1).handle_message read tag failed 2021-03-09T10:15:47.599 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:47.595+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000bed0 :-1 s=OPENED pgs=3820 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:15:49.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:49.223+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:15:49.224 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:49.223+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:15:52.597 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:15:52.595+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:15:55.630 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:55.627+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:15:55.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:15:55.627+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:15:57.598 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:15:57.595+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:16:02.598 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:16:02.595+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:16:07.598 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:16:07.595+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:16:08.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:08.443+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:16:08.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:08.443+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:16:12.598 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:16:12.598+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:16:13.007 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:13.006+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:16:13.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:13.006+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:16:13.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:13.006+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:16:13.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:13.006+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T10:16:13.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:13.006+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20003eb0 2021-03-09T10:16:13.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:13.006+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200107c0 con 0x7fdd20006b10 2021-03-09T10:16:13.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:13.006+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:16:13.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:13.006+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:16:13.211 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:13.210+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:16:13.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:13.210+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:16:13.615 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:13.614+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:16:13.621 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:13.614+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:16:14.419 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:14.418+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:16:14.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:14.418+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:16:16.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:16.022+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:16:16.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:16.022+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:16:17.599 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:16:17.594+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:16:17.599 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:17.594+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:16:17.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:17.594+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:16:17.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:17.594+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000bed0 :-1 s=OPENED pgs=3837 cs=1 l=1).handle_message read tag failed 2021-03-09T10:16:17.600 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:17.594+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000bed0 :-1 s=OPENED pgs=3837 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:16:19.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:19.226+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:16:19.228 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:19.226+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:16:22.599 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:16:22.598+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:16:25.632 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:25.630+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:16:25.634 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:25.630+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:16:27.599 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:16:27.598+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:16:32.599 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:16:32.598+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:16:37.600 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:16:37.598+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:16:38.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:38.434+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:16:38.445 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:38.442+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:16:42.600 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:16:42.598+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:16:43.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:43.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:16:43.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:43.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:16:43.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:43.002+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:16:43.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:43.006+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c5e0 con 0x7fdd200032a0 2021-03-09T10:16:43.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:43.006+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200103e0 2021-03-09T10:16:43.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:43.006+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:16:43.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:43.006+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:16:43.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:43.006+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:16:43.211 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:43.210+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:16:43.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:43.210+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:16:43.615 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:43.614+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:16:43.616 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:43.614+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:16:44.419 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:44.418+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:16:44.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:44.418+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:16:46.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:46.022+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:16:46.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:46.022+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:16:47.600 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:16:47.597+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:16:47.601 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:47.597+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:16:47.601 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:47.597+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:16:47.601 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:47.597+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000f640 :-1 s=OPENED pgs=3854 cs=1 l=1).handle_message read tag failed 2021-03-09T10:16:47.602 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:47.597+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000f640 :-1 s=OPENED pgs=3854 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:16:49.228 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:49.225+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:16:49.228 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:49.225+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:16:52.601 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:16:52.597+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:16:55.634 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:55.633+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:16:55.634 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:16:55.633+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:16:57.601 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:16:57.601+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:17:02.601 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:17:02.601+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:17:07.601 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:17:07.597+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:17:08.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:08.445+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:17:08.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:08.445+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:17:12.601 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:17:12.601+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:17:13.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:13.005+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:17:13.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:13.005+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:17:13.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:13.005+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:17:13.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:13.005+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:17:13.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:13.005+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c5e0 con 0x7fdd200103e0 2021-03-09T10:17:13.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:13.005+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:17:13.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:13.005+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:17:13.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:13.005+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:17:13.208 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:13.209+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:17:13.209 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:13.209+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:17:13.615 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:13.613+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:17:13.616 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:13.613+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:17:14.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:14.417+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:17:14.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:14.417+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:17:16.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:16.021+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:17:16.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:16.021+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:17:17.601 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:17:17.601+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:17:17.602 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:17.601+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:17:17.603 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:17.601+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:17:17.603 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:17.601+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3871 cs=1 l=1).handle_message read tag failed 2021-03-09T10:17:17.603 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:17.601+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3871 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:17:19.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:19.225+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:17:19.228 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:19.225+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:17:22.602 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:17:22.600+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:17:25.634 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:25.632+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:17:25.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:25.632+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:17:27.602 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:17:27.596+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:17:32.602 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:17:32.600+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:17:37.603 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:17:37.596+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:17:38.448 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:38.448+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:17:38.448 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:38.448+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:17:42.603 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:17:42.600+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:17:43.008 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:43.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:17:43.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:43.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:17:43.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:43.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:17:43.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:43.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd200032a0 2021-03-09T10:17:43.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:43.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200103e0 2021-03-09T10:17:43.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:43.008+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:17:43.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:43.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c5e0 con 0x7fdd20006b10 2021-03-09T10:17:43.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:43.008+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:17:43.211 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:43.212+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:17:43.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:43.212+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:17:43.615 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:43.616+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:17:43.616 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:43.616+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:17:44.419 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:44.420+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:17:44.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:44.420+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:17:46.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:46.024+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:17:46.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:46.024+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:17:47.603 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:17:47.600+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:17:47.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:47.600+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:17:47.604 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:47.600+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:17:47.605 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:47.600+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3888 cs=1 l=1).handle_message read tag failed 2021-03-09T10:17:47.605 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:47.600+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3888 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:17:49.229 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:49.228+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:17:49.229 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:49.228+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:17:52.603 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:17:52.604+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:17:55.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:55.632+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:17:55.634 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:17:55.632+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:17:57.604 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:17:57.603+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:18:02.604 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:18:02.603+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:18:07.604 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:18:07.603+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:18:08.444 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:08.443+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:18:08.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:08.447+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:18:12.604 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:18:12.603+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:18:13.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:13.007+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:18:13.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:13.007+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:18:13.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:13.007+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:18:13.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:13.007+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T10:18:13.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:13.007+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd200103e0 2021-03-09T10:18:13.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:13.007+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:18:13.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:13.007+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:18:13.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:13.007+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:18:13.211 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:13.211+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:18:13.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:13.211+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:18:13.615 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:13.615+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:18:13.616 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:13.615+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:18:14.419 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:14.419+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:18:14.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:14.419+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:18:16.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:16.023+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:18:16.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:16.023+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:18:17.605 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:18:17.603+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:18:17.605 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:17.603+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:18:17.606 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:17.603+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:18:17.606 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:17.603+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3905 cs=1 l=1).handle_message read tag failed 2021-03-09T10:18:17.606 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:17.603+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3905 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:18:19.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:19.227+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:18:19.228 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:19.227+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:18:22.605 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:18:22.603+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:18:25.634 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:25.631+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:18:25.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:25.631+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:18:27.605 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:18:27.603+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:18:32.605 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:18:32.602+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:18:37.605 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:18:37.602+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:18:38.446 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:38.442+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:18:38.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:38.442+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:18:42.605 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:18:42.602+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:18:43.009 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:43.006+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:18:43.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:43.006+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200103e0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:18:43.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:43.006+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:18:43.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:43.006+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fd50 con 0x7fdd200032a0 2021-03-09T10:18:43.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:43.006+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:18:43.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:43.006+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:18:43.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:43.006+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:18:43.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:43.006+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:18:43.211 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:43.210+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:18:43.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:43.210+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:18:43.615 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:43.614+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:18:43.616 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:43.614+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:18:44.419 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:44.418+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:18:44.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:44.418+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:18:46.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:46.022+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:18:46.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:46.022+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:18:47.606 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:18:47.602+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:18:47.607 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:47.602+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:18:47.607 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:47.602+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:18:47.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:47.602+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3922 cs=1 l=1).handle_message read tag failed 2021-03-09T10:18:47.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:47.602+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3922 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:18:49.229 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:49.226+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:18:49.258 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:49.226+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:18:52.606 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:18:52.602+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:18:55.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:55.630+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:18:55.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:18:55.630+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:18:57.606 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:18:57.602+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:19:02.606 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:19:02.606+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:19:07.607 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:19:07.606+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:19:08.448 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:08.446+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:19:08.448 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:08.446+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:19:12.607 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:19:12.605+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:19:13.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:13.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:19:13.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:13.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:19:13.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:13.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:19:13.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:13.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200032a0 2021-03-09T10:19:13.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:13.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fd50 con 0x7fdd2000bed0 2021-03-09T10:19:13.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:13.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:19:13.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:13.009+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:19:13.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:13.009+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:19:13.215 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:13.213+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:19:13.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:13.213+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:19:13.619 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:13.617+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:19:13.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:13.617+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:19:14.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:14.421+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:19:14.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:14.421+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:19:16.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:16.025+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:19:16.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:16.025+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:19:17.607 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:17.605+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:19:17.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:17.605+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:19:17.608 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:17.605+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3939 cs=1 l=1).handle_message read tag failed 2021-03-09T10:19:17.609 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:19:17.601+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:19:17.609 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:17.605+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3939 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:19:19.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:19.229+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:19:19.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:19.229+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:19:22.608 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:19:22.605+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:19:25.636 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:25.633+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:19:25.636 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:25.633+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:19:27.608 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:19:27.605+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:19:32.608 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:19:32.605+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:19:37.608 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:19:37.605+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:19:38.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:38.445+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:19:38.448 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:38.445+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:19:42.608 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:19:42.605+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:19:43.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:43.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:19:43.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:43.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:19:43.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:43.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:19:43.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:43.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd200032a0 2021-03-09T10:19:43.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:43.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000bed0 2021-03-09T10:19:43.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:43.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fd50 con 0x7fdd20006b10 2021-03-09T10:19:43.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:43.009+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:19:43.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:43.009+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:19:43.215 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:43.213+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:19:43.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:43.213+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:19:43.619 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:43.617+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:19:43.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:43.617+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:19:44.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:44.421+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:19:44.421 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:44.421+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:19:46.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:46.024+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:19:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:46.024+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:19:47.609 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:47.604+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:19:47.609 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:19:47.604+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:19:47.610 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:47.604+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:19:47.610 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:47.604+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3956 cs=1 l=1).handle_message read tag failed 2021-03-09T10:19:47.611 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:47.604+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=3956 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:19:49.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:49.228+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:19:49.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:49.228+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:19:52.609 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:19:52.608+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:19:55.638 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:55.636+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:19:55.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:19:55.636+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:19:57.609 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:19:57.608+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:20:02.609 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:20:02.608+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:20:07.610 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:20:07.608+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:20:08.444 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:08.444+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:20:08.451 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:08.448+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:20:12.610 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:20:12.608+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:20:13.010 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:13.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:20:13.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:13.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:20:13.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:13.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:20:13.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:13.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:20:13.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:13.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd2000bed0 2021-03-09T10:20:13.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:13.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:20:13.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:13.008+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:20:13.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:13.008+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:20:13.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:13.212+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:20:13.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:13.212+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:20:13.615 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:13.616+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:20:13.616 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:13.616+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:20:14.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:14.420+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:20:14.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:14.420+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:20:16.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:16.024+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:20:16.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:16.024+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:20:17.610 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:20:17.608+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:20:17.611 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:17.608+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:20:17.611 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:17.608+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:20:17.611 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:17.608+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3973 cs=1 l=1).handle_message read tag failed 2021-03-09T10:20:17.612 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:17.608+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3973 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:20:19.228 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:19.228+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:20:19.228 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:19.228+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:20:22.610 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:20:22.607+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:20:25.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:25.631+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:20:25.636 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:25.631+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:20:27.611 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:20:27.607+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:20:32.611 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:20:32.611+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:20:37.611 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:20:37.611+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:20:38.436 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:38.435+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:20:38.436 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:38.435+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:20:42.611 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:20:42.607+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:20:43.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:43.007+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:20:43.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:43.007+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:20:43.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:43.007+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:20:43.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:43.007+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c2b0 con 0x7fdd20003eb0 2021-03-09T10:20:43.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:43.007+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T10:20:43.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:43.007+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:20:43.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:43.007+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:20:43.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:43.007+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:20:43.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:43.211+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:20:43.212 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:43.211+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:20:43.615 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:43.615+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:20:43.616 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:43.615+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:20:44.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:44.419+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:20:44.420 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:44.419+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:20:46.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:46.023+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:20:46.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:46.023+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:20:47.612 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:20:47.611+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:20:47.612 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:47.611+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:20:47.613 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:47.611+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:20:47.613 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:47.611+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3990 cs=1 l=1).handle_message read tag failed 2021-03-09T10:20:47.613 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:47.611+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=3990 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:20:49.228 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:49.227+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:20:49.228 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:49.227+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:20:52.612 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:20:52.611+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:20:55.634 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:55.631+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:20:55.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:20:55.631+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:20:57.612 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:20:57.610+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:21:02.612 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:21:02.610+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:21:07.612 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:21:07.610+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:21:08.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:08.442+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:21:08.448 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:08.446+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:21:12.612 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:21:12.610+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:21:13.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:13.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:21:13.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:13.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:21:13.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:13.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:21:13.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:13.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:21:13.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:13.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c2b0 con 0x7fdd200032a0 2021-03-09T10:21:13.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:13.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:21:13.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:13.010+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:21:13.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:13.010+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:21:13.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:13.214+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:21:13.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:13.214+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:21:13.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:13.618+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:21:13.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:13.618+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:21:14.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:14.422+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:21:14.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:14.422+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:21:16.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:16.026+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:21:16.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:16.026+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:21:17.613 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:21:17.610+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:21:17.614 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:17.610+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:21:17.614 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:17.610+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:21:17.614 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:17.610+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4006 cs=1 l=1).handle_message read tag failed 2021-03-09T10:21:17.614 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:17.610+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4006 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:21:19.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:19.230+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:21:19.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:19.230+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:21:22.613 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:21:22.610+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:21:25.638 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:25.634+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:21:25.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:25.634+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:21:27.613 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:21:27.610+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:21:32.614 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:21:32.610+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:21:37.614 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:21:37.609+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:21:38.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:38.445+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:21:38.450 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:38.445+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:21:42.614 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:21:42.609+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:21:43.011 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:43.005+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:21:43.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:43.005+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:21:43.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:43.005+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:21:43.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:43.005+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20003eb0 2021-03-09T10:21:43.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:43.005+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200032a0 2021-03-09T10:21:43.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:43.005+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c2b0 con 0x7fdd20006b10 2021-03-09T10:21:43.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:43.009+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:21:43.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:43.009+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:21:43.215 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:43.213+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:21:43.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:43.213+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:21:43.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:43.617+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:21:43.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:43.617+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:21:44.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:44.421+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:21:44.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:44.421+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:21:46.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:46.025+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:21:46.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:46.025+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:21:47.615 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:21:47.613+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:21:47.616 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:47.613+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:21:47.616 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:47.613+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:21:47.616 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:47.613+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4027 cs=1 l=1).handle_message read tag failed 2021-03-09T10:21:47.616 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:47.613+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4027 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:21:49.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:49.229+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:21:49.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:49.229+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:21:52.615 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:21:52.609+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:21:55.638 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:55.637+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:21:55.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:21:55.637+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:21:57.615 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:21:57.613+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:22:02.615 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:22:02.613+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:22:07.616 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:22:07.613+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:22:08.445 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:08.445+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:22:08.451 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:08.449+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:22:12.616 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:22:12.612+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:22:13.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:13.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:22:13.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:13.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:22:13.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:13.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:22:13.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:13.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000bed0 2021-03-09T10:22:13.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:13.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd200032a0 2021-03-09T10:22:13.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:13.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:22:13.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:13.008+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:22:13.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:13.008+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:22:13.215 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:13.212+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:22:13.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:13.212+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:22:13.616 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:13.616+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:22:13.617 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:13.616+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:22:14.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:14.420+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:22:14.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:14.420+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:22:16.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:16.024+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:22:16.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:16.024+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:22:17.616 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:22:17.616+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:22:17.617 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:17.616+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:22:17.617 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:17.616+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:22:17.617 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:17.616+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4064 cs=1 l=1).handle_message read tag failed 2021-03-09T10:22:17.618 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:17.616+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4064 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:22:19.229 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:19.228+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:22:19.230 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:19.228+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:22:22.617 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:22:22.612+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:22:25.636 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:25.636+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:22:25.637 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:25.636+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:22:27.617 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:22:27.612+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:22:32.617 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:22:32.616+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:22:37.617 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:22:37.616+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:22:38.449 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:38.448+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:22:38.450 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:38.448+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:22:42.618 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:22:42.616+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:22:43.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:22:43.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:22:43.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:22:43.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003720 con 0x7fdd2000bed0 2021-03-09T10:22:43.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T10:22:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:22:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:43.012+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:22:43.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:43.012+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:22:43.215 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:43.216+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:22:43.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:43.216+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:22:43.619 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:43.620+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:22:43.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:43.620+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:22:44.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:44.424+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:22:44.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:44.424+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:22:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:46.028+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:22:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:46.028+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:22:47.618 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:22:47.615+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:22:47.619 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:47.615+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:22:47.619 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:47.615+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:22:47.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:47.615+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4101 cs=1 l=1).handle_message read tag failed 2021-03-09T10:22:47.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:47.615+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4101 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:22:49.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:49.231+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:22:49.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:49.231+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:22:52.619 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:22:52.615+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:22:55.638 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:55.635+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:22:55.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:22:55.635+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:22:57.619 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:22:57.619+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:23:02.619 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:23:02.619+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:23:07.619 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:23:07.619+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:23:08.452 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:08.451+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:23:08.452 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:08.451+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:23:12.620 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:23:12.619+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:23:13.012 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:13.011+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:23:13.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:13.011+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:23:13.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:13.011+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000bed0 legacy=0x7fdd2000a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:23:13.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:13.011+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:23:13.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:13.011+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:23:13.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:13.011+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003720 con 0x7fdd200032a0 2021-03-09T10:23:13.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:13.011+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:23:13.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:13.011+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:23:13.215 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:13.215+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:23:13.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:13.215+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:23:13.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:13.619+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:23:13.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:13.619+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:23:14.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:14.423+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:23:14.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:14.423+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:23:16.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:16.027+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:23:16.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:16.027+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:23:17.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:17.619+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:23:17.621 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:17.619+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:23:17.621 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:17.619+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4134 cs=1 l=1).handle_message read tag failed 2021-03-09T10:23:17.621 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:17.619+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4134 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:23:17.621 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:23:17.619+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:23:19.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:19.231+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:23:19.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:19.231+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:23:22.620 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:23:22.619+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:23:25.638 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:25.638+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:23:25.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:25.638+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:23:27.621 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:23:27.618+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:23:32.621 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:23:32.618+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:23:37.621 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:23:37.618+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:23:38.450 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:38.450+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:23:38.451 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:38.450+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:23:42.621 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:23:42.618+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:23:43.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:43.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:23:43.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:43.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:23:43.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:43.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:23:43.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:43.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20003eb0 2021-03-09T10:23:43.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:43.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20014830 2021-03-09T10:23:43.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:43.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003720 con 0x7fdd20006b10 2021-03-09T10:23:43.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:43.010+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:23:43.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:43.010+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:23:43.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:43.214+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:23:43.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:43.214+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:23:43.619 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:43.618+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:23:43.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:43.618+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:23:44.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:44.422+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:23:44.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:44.422+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:23:46.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:46.026+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:23:46.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:46.026+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:23:47.622 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:23:47.618+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:23:47.622 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:47.618+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:23:47.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:47.618+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:23:47.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:47.618+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4151 cs=1 l=1).handle_message read tag failed 2021-03-09T10:23:47.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:47.618+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4151 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:23:49.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:49.230+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:23:49.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:49.230+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:23:52.622 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:23:52.622+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:23:55.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:55.634+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:23:55.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:23:55.634+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:23:57.622 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:23:57.622+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:24:02.623 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:24:02.621+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:24:07.622 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:24:07.621+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:24:08.452 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:08.449+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:24:08.452 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:08.449+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:24:12.622 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:24:12.621+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:24:13.013 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:13.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:24:13.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:13.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:24:13.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:13.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:24:13.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:13.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T10:24:13.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:13.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20014830 2021-03-09T10:24:13.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:13.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:24:13.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:13.009+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:24:13.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:13.009+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:24:13.215 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:13.213+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:24:13.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:13.213+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:24:13.619 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:13.617+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:24:13.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:13.617+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:24:14.421 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:14.421+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:24:14.421 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:14.421+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:24:16.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:16.025+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:24:16.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:16.025+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:24:17.623 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:24:17.621+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:24:17.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:17.621+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:24:17.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:17.621+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:24:17.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:17.621+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4168 cs=1 l=1).handle_message read tag failed 2021-03-09T10:24:17.625 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:17.621+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4168 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:24:19.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:19.229+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:24:19.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:19.229+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:24:22.623 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:24:22.621+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:24:25.638 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:25.637+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:24:25.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:25.637+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:24:27.623 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:24:27.621+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:24:32.623 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:24:32.621+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:24:37.624 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:24:37.621+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:24:38.452 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:38.448+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:24:38.452 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:38.448+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:24:42.625 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:24:42.620+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:24:43.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:43.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:24:43.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:43.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:24:43.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:43.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:24:43.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:43.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003720 con 0x7fdd200032a0 2021-03-09T10:24:43.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:43.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20014830 2021-03-09T10:24:43.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:43.008+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:24:43.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:43.008+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:24:43.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:43.008+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:24:43.214 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:43.212+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:24:43.214 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:43.212+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:24:43.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:43.616+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:24:43.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:43.616+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:24:44.421 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:44.420+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:24:44.421 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:44.420+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:24:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:46.024+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:24:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:46.024+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:24:47.624 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:24:47.620+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:24:47.625 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:47.620+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:24:47.625 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:47.620+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:24:47.625 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:47.620+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4185 cs=1 l=1).handle_message read tag failed 2021-03-09T10:24:47.626 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:47.620+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4185 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:24:49.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:49.228+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:24:49.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:49.228+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:24:52.625 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:24:52.620+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:24:55.636 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:55.632+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:24:55.638 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:24:55.632+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:24:57.625 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:24:57.624+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:25:02.625 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:25:02.624+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:25:07.626 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:25:07.624+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:25:08.450 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:08.448+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:25:08.455 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:08.448+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:25:12.625 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:25:12.624+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:25:13.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:25:13.014 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:25:13.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:25:13.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20014830 2021-03-09T10:25:13.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003720 con 0x7fdd20003eb0 2021-03-09T10:25:13.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:25:13.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:13.012+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:25:13.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:13.012+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:25:13.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:13.216+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:25:13.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:13.216+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:25:13.619 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:13.620+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:25:13.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:13.620+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:25:14.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:14.424+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:25:14.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:14.424+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:25:16.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:16.027+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:25:16.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:16.027+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:25:17.626 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:17.623+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:25:17.626 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:17.623+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:25:17.627 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:25:17.623+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:25:17.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:17.623+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4202 cs=1 l=1).handle_message read tag failed 2021-03-09T10:25:17.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:17.623+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4202 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:25:19.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:19.231+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:25:19.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:19.231+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:25:22.626 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:25:22.623+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:25:25.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:25.635+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:25:25.636 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:25.635+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:25:27.627 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:25:27.623+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:25:32.627 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:25:32.623+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:25:37.627 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:25:37.627+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:25:38.449 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:38.447+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:25:38.450 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:38.447+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:25:39.108 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:39.107+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-03-09T10:25:39.108 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:39.107+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:25:39.108 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:39.107+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 0x7fdd2405ba90 :-1 s=OPENED pgs=116 cs=1 l=1).handle_message read tag failed 2021-03-09T10:25:39.109 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:39.107+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 0x7fdd2405ba90 :-1 s=OPENED pgs=116 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:25:39.109 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:39.107+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405ba90 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting, fault. 2021-03-09T10:25:39.109 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:39.107+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405ba90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:25:42.627 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:25:42.623+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:25:43.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:43.011+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:25:43.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:43.011+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:25:43.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:43.011+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:25:43.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:43.011+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd200032a0 2021-03-09T10:25:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:43.011+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:25:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:43.011+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003720 con 0x7fdd20006b10 2021-03-09T10:25:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:43.011+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:25:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:43.011+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:25:43.215 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:43.215+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:25:43.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:43.215+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:25:43.619 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:43.619+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:25:43.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:43.619+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:25:44.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:44.423+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:25:44.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:44.423+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:25:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:46.027+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:25:46.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:46.027+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:25:47.627 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:25:47.623+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:25:47.628 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:47.623+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:25:47.628 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:47.627+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:25:47.628 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:47.627+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4219 cs=1 l=1).handle_message read tag failed 2021-03-09T10:25:47.629 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:47.627+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=4219 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:25:49.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:49.231+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:25:49.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:49.231+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:25:52.628 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:25:52.627+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:25:55.636 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:55.634+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:25:55.636 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:25:55.634+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:25:57.628 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:25:57.626+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:26:02.628 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:26:02.626+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:26:07.628 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:26:07.626+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:26:08.449 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:08.446+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:26:08.449 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:08.446+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:26:12.628 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:26:12.626+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:26:13.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:13.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:26:13.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:13.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:26:13.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:13.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:26:13.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:13.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20014830 2021-03-09T10:26:13.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:13.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20019a60 2021-03-09T10:26:13.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:13.010+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:26:13.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:13.010+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:26:13.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:13.010+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2001be50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:26:13.215 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:13.214+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2001be50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:26:13.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:13.214+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:26:13.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:13.618+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:26:13.633 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:13.618+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2001be50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:26:14.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:14.422+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:26:14.429 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:14.422+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2001be50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:26:16.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:16.026+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:26:16.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:16.026+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2001be50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:26:17.629 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:26:17.626+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:26:17.629 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:17.626+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:26:17.630 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:17.626+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:26:17.630 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:17.626+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4236 cs=1 l=1).handle_message read tag failed 2021-03-09T10:26:17.630 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:17.626+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4236 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:26:19.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:19.230+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:26:19.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:19.230+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2001be50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:26:22.629 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:26:22.626+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:26:25.638 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:25.638+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:26:25.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:25.638+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2001be50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:26:27.629 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:26:27.630+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:26:32.629 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:26:32.629+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:26:37.630 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:26:37.629+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:26:38.451 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:38.445+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:26:38.452 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:38.449+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2001be50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:26:42.630 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:26:42.625+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:26:43.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:43.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:26:43.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:43.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2001be50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:26:43.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:43.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:26:43.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:43.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003720 con 0x7fdd200032a0 2021-03-09T10:26:43.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:43.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20019a60 2021-03-09T10:26:43.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:43.009+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:26:43.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:43.009+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:26:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:43.009+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:26:43.215 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:43.213+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:26:43.216 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:43.213+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:26:43.619 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:43.617+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:26:43.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:43.617+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:26:44.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:44.421+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:26:44.437 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:44.421+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:26:46.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:46.025+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:26:46.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:46.025+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:26:47.630 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:26:47.625+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:26:47.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:47.625+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:26:47.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:47.625+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:26:47.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:47.625+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4253 cs=1 l=1).handle_message read tag failed 2021-03-09T10:26:47.632 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:47.625+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4253 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:26:49.229 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:49.229+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:26:49.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:49.229+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:26:52.630 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:26:52.625+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:26:55.636 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:55.633+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:26:55.636 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:26:55.633+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:26:57.631 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:26:57.629+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:27:02.631 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:27:02.629+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:27:07.631 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:27:07.624+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:27:08.444 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:08.440+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:27:08.448 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:08.444+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:27:12.631 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:27:12.628+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:27:13.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:27:13.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:27:13.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:27:13.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200032a0 2021-03-09T10:27:13.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003720 con 0x7fdd20019a60 2021-03-09T10:27:13.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:27:13.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:13.012+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:27:13.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:13.012+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:27:13.219 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:13.216+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:27:13.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:13.216+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:27:13.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:13.620+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:27:13.620 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:13.620+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:27:14.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:14.424+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:27:14.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:14.424+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:27:16.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:16.028+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:27:16.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:16.028+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:27:17.631 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:27:17.628+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:27:17.632 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:17.628+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:27:17.633 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:17.628+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:27:17.633 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:17.628+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4270 cs=1 l=1).handle_message read tag failed 2021-03-09T10:27:17.633 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:17.628+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4270 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:27:19.233 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:19.232+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:27:19.234 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:19.232+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:27:22.632 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:27:22.632+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:27:25.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:25.636+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:27:25.640 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:25.636+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:27:27.632 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:27:27.632+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:27:32.632 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:27:32.632+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:27:37.632 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:27:37.632+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:27:38.452 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:38.452+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:27:38.453 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:38.452+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:27:42.633 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:27:42.632+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:27:43.015 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:27:43.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:27:43.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:27:43.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20014830 2021-03-09T10:27:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:27:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003720 con 0x7fdd20006b10 2021-03-09T10:27:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:43.016+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:27:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:43.016+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:27:43.219 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:43.220+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:27:43.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:43.220+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:27:43.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:43.624+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:27:43.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:43.624+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:27:44.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:44.428+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:27:44.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:44.428+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:27:46.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:46.031+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:27:46.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:46.031+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:27:47.633 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:27:47.631+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:27:47.634 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:47.631+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:27:47.634 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:47.631+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:27:47.634 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:47.631+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4287 cs=1 l=1).handle_message read tag failed 2021-03-09T10:27:47.634 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:47.631+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4287 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:27:49.236 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:49.235+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:27:49.236 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:49.235+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:27:52.633 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:27:52.631+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:27:55.642 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:55.639+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:27:55.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:27:55.639+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:27:57.633 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:27:57.631+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:28:02.634 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:28:02.631+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:28:07.634 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:28:07.631+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:28:08.453 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:08.451+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:28:08.454 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:08.451+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:28:12.634 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:28:12.631+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:28:13.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:13.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:28:13.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:13.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20017f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:28:13.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:13.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:28:13.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:13.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20014830 2021-03-09T10:28:13.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:13.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20003eb0 2021-03-09T10:28:13.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:13.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:28:13.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:13.015+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:28:13.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:13.015+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:28:13.219 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:13.219+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:28:13.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:13.219+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:28:13.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:13.623+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:28:13.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:13.623+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:28:14.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:14.427+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:28:14.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:14.427+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:28:16.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:16.031+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:28:16.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:16.031+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:28:17.634 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:28:17.631+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:28:17.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:17.631+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:28:17.636 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:17.631+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:28:17.636 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:17.631+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4304 cs=1 l=1).handle_message read tag failed 2021-03-09T10:28:17.636 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:17.631+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4304 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:28:19.236 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:19.235+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:28:19.236 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:19.235+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:28:22.635 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:28:22.631+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:28:25.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:25.638+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:28:25.642 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:25.638+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:28:27.635 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:28:27.630+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:28:32.635 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:28:32.634+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:28:37.635 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:28:37.630+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:28:38.453 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:38.450+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:28:38.453 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:38.450+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:28:42.635 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:28:42.634+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:28:43.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:43.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:28:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:43.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:28:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:43.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20014830 legacy=0x7fdd20014c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:28:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:43.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003720 con 0x7fdd200032a0 2021-03-09T10:28:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:43.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:28:43.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:43.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:28:43.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:43.014+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:28:43.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:43.014+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:28:43.219 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:43.218+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:28:43.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:43.218+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:28:43.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:43.622+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:28:43.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:43.622+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:28:44.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:44.426+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:28:45.735 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:44.426+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:28:46.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:46.030+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:28:46.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:46.030+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:28:47.636 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:28:47.634+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:28:47.637 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:47.634+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:28:47.637 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:47.634+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:28:47.637 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:47.634+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4321 cs=1 l=1).handle_message read tag failed 2021-03-09T10:28:47.637 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:47.634+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4321 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:28:49.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:49.234+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:28:49.236 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:49.234+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:28:52.636 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:28:52.634+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:28:55.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:55.638+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:28:55.642 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:28:55.638+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:28:57.636 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:28:57.634+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:29:02.636 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:29:02.633+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:29:07.637 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:29:07.633+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:29:08.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:08.441+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:29:08.444 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:08.441+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:29:12.637 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:29:12.637+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:29:13.016 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:13.013+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:29:13.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:13.013+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:29:13.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:13.013+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:29:13.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:13.013+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200032a0 2021-03-09T10:29:13.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:13.013+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003720 con 0x7fdd20003eb0 2021-03-09T10:29:13.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:13.013+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:29:13.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:13.013+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:29:13.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:13.013+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:29:13.219 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:13.217+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:29:13.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:13.217+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:29:13.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:13.621+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:29:13.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:13.621+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:29:14.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:14.425+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:29:14.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:14.425+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:29:16.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:16.029+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:29:16.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:16.029+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:29:17.637 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:29:17.637+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:29:17.638 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:17.637+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:29:17.638 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:17.637+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:29:17.638 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:17.637+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4338 cs=1 l=1).handle_message read tag failed 2021-03-09T10:29:17.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:17.637+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4338 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:29:19.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:19.233+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:29:19.236 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:19.233+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:29:22.637 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:29:22.633+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:29:25.642 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:25.641+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:29:25.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:25.641+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:29:27.638 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:29:27.637+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:29:32.638 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:29:32.637+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:29:37.638 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:29:37.633+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:29:38.455 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:38.452+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:29:38.456 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:38.452+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:29:42.638 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:29:42.636+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:29:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:29:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:29:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:29:43.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20003eb0 2021-03-09T10:29:43.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20015f50 2021-03-09T10:29:43.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:43.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003720 con 0x7fdd20006b10 2021-03-09T10:29:43.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:43.012+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:29:43.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:43.012+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:29:43.217 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:43.216+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:29:43.217 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:43.216+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:29:43.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:43.620+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:29:43.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:43.620+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:29:44.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:44.424+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:29:44.425 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:44.424+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:29:46.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:46.028+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:29:46.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:46.028+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:29:47.639 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:29:47.636+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:29:47.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:47.636+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:29:47.640 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:47.636+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:29:47.640 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:47.636+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4355 cs=1 l=1).handle_message read tag failed 2021-03-09T10:29:47.640 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:47.636+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4355 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:29:49.233 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:49.232+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:29:49.234 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:49.232+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:29:52.639 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:29:52.636+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:29:55.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:55.636+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:29:55.640 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:29:55.636+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:29:57.639 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:29:57.636+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:30:02.639 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:30:02.636+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:30:07.639 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:30:07.640+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:30:08.451 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:08.452+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:30:08.452 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:08.452+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:30:12.639 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:30:12.640+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:30:13.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:13.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:30:13.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:13.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:30:13.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:13.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:30:13.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:13.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T10:30:13.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:13.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20015f50 2021-03-09T10:30:13.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:13.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:30:13.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:13.016+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:30:13.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:13.016+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:30:13.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:13.220+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:30:13.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:13.220+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:30:13.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:13.624+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:30:13.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:13.624+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:30:14.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:14.428+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:30:14.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:14.428+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:30:16.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:16.031+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:30:16.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:16.031+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:30:17.640 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:30:17.639+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:30:17.640 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:17.639+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:30:17.641 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:17.639+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:30:17.641 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:17.639+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4372 cs=1 l=1).handle_message read tag failed 2021-03-09T10:30:17.641 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:17.639+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4372 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:30:19.236 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:19.235+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:30:19.236 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:19.235+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:30:22.640 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:30:22.639+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:30:25.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:25.639+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:30:25.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:25.639+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:30:27.640 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:30:27.639+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:30:32.641 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:30:32.639+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:30:37.641 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:30:37.639+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:30:38.456 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:38.455+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:30:38.456 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:38.455+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:30:42.641 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:30:42.639+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:30:43.017 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:43.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:30:43.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:43.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:30:43.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:43.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:30:43.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:43.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd200032a0 2021-03-09T10:30:43.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:43.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20015f50 2021-03-09T10:30:43.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:43.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:30:43.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:43.015+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:30:43.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:43.015+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:30:43.219 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:43.219+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:30:43.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:43.219+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:30:43.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:43.623+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:30:43.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:43.623+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:30:44.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:44.427+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:30:44.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:44.427+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:30:46.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:46.031+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:30:46.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:46.031+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:30:47.641 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:30:47.639+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:30:47.642 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:47.639+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:30:47.642 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:47.639+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:30:47.642 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:47.639+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4389 cs=1 l=1).handle_message read tag failed 2021-03-09T10:30:47.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:47.639+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4389 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:30:49.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:49.235+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:30:49.236 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:49.235+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:30:52.642 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:30:52.639+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:30:55.642 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:55.638+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:30:55.642 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:30:55.638+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:30:57.642 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:30:57.642+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:31:02.642 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:31:02.642+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:31:07.642 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:31:07.642+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:31:08.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:08.442+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:31:08.456 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:08.450+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:31:12.642 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:31:12.642+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:31:13.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:13.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:31:13.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:13.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:31:13.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:13.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:31:13.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:13.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200032a0 2021-03-09T10:31:13.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:13.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd20015f50 2021-03-09T10:31:13.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:13.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:31:13.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:13.014+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:31:13.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:13.014+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:31:13.219 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:13.218+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:31:13.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:13.218+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:31:13.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:13.622+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:31:13.709 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:13.622+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:31:14.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:14.426+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:31:14.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:14.426+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:31:16.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:16.030+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:31:16.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:16.030+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:31:17.643 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:31:17.638+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:31:17.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:17.638+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:31:17.644 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:17.638+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:31:17.644 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:17.638+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4406 cs=1 l=1).handle_message read tag failed 2021-03-09T10:31:17.644 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:17.638+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4406 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:31:19.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:19.234+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:31:19.236 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:19.234+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:31:22.643 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:31:22.642+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:31:25.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:25.642+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:31:25.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:25.642+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:31:27.643 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:31:27.642+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:31:32.648 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:31:32.641+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:31:37.643 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:31:37.641+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:31:38.456 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:38.453+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:31:38.456 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:38.453+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:31:42.644 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:31:42.641+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:31:43.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:43.013+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:31:43.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:43.013+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20015f50 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:31:43.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:43.013+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20014830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:31:43.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:43.013+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20019a60 2021-03-09T10:31:43.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:43.013+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:31:43.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:43.013+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd20006b10 2021-03-09T10:31:43.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:43.013+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:31:43.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:43.013+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:31:43.219 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:43.217+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:31:43.219 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:43.217+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:31:43.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:43.621+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:31:43.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:43.621+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:31:44.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:44.425+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:31:44.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:44.425+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:31:46.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:46.029+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:31:46.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:46.029+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:31:47.644 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:31:47.641+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:31:48.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:47.641+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:31:48.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:47.641+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:31:48.003 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:47.641+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4423 cs=1 l=1).handle_message read tag failed 2021-03-09T10:31:48.004 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:47.641+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4423 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:31:49.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:49.233+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:31:49.234 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:49.233+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:31:52.644 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:31:52.641+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:31:55.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:55.637+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:31:55.640 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:31:55.637+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:31:57.644 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:31:57.641+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:32:02.645 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:32:02.645+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:32:07.645 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:32:07.645+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:32:08.452 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:08.449+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:32:08.454 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:08.449+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:32:12.645 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:32:12.644+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:32:13.018 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:32:13.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20018340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:32:13.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20019a60 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:32:13.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T10:32:13.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20003eb0 2021-03-09T10:32:13.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:13.012+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:32:13.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:13.012+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:32:13.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:13.012+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:32:13.219 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:13.216+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:32:13.219 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:13.216+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:32:13.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:13.620+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:32:13.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:13.620+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:32:14.424 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:14.424+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:32:14.425 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:14.424+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:32:16.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:16.028+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:32:16.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:16.028+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:32:17.645 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:32:17.644+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:32:17.646 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:17.644+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:32:17.646 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:17.644+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:32:17.647 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:17.644+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4440 cs=1 l=1).handle_message read tag failed 2021-03-09T10:32:17.647 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:17.644+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4440 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:32:19.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:19.232+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:32:19.236 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:19.232+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:32:22.646 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:32:22.644+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:32:25.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:25.640+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:32:25.644 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:25.640+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:32:27.646 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:32:27.644+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:32:32.646 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:32:32.644+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:32:37.646 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:32:37.644+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:32:38.455 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:38.452+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:32:38.455 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:38.456+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:32:42.646 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:32:42.644+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:32:43.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:43.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:32:43.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:43.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:32:43.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:43.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:32:43.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:43.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd200032a0 2021-03-09T10:32:43.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:43.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000ef30 2021-03-09T10:32:43.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:43.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:32:43.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:43.016+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:32:43.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:43.016+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:32:43.219 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:43.220+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:32:43.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:43.220+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:32:43.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:43.624+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:32:43.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:43.624+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:32:44.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:44.428+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:32:44.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:44.428+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:32:46.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:46.032+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:32:46.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:46.032+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:32:47.647 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:32:47.644+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:32:47.647 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:47.644+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:32:47.648 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:47.644+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:32:47.648 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:47.644+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4457 cs=1 l=1).handle_message read tag failed 2021-03-09T10:32:47.648 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:47.644+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4457 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:32:49.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:49.235+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:32:49.237 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:49.235+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:32:52.647 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:32:52.647+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:32:55.642 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:55.639+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:32:55.644 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:32:55.643+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:32:57.647 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:32:57.647+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:33:02.647 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:33:02.647+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:33:07.648 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:33:07.647+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:33:08.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:08.443+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:33:08.457 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:08.455+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:33:12.648 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:33:12.647+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:33:13.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:13.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:33:13.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:13.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:33:13.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:13.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:33:13.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:13.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:33:13.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:13.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd2000ef30 2021-03-09T10:33:13.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:13.015+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:33:13.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:13.015+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:33:13.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:13.015+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:33:13.219 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:13.219+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:33:13.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:13.219+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:33:13.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:13.623+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:33:13.624 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:13.623+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:33:14.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:14.427+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:33:14.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:14.427+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:33:16.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:16.031+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:33:16.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:16.031+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:33:17.648 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:33:17.647+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:33:17.649 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:17.647+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:33:17.649 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:17.647+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:33:17.649 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:17.647+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4478 cs=1 l=1).handle_message read tag failed 2021-03-09T10:33:17.650 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:17.647+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4478 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:33:19.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:19.235+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:33:19.236 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:19.235+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:33:22.649 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:33:22.647+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:33:25.642 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:25.639+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:33:25.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:25.639+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:33:27.649 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:33:27.646+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:33:32.649 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:33:32.646+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:33:37.649 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:33:37.646+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:33:38.455 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:38.454+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:33:38.456 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:38.454+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:33:42.650 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:33:42.646+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:33:43.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:43.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:33:43.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:43.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:33:43.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:43.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:33:43.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:43.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20003eb0 2021-03-09T10:33:43.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:43.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000ef30 2021-03-09T10:33:43.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:43.014+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd20006b10 2021-03-09T10:33:43.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:43.014+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:33:43.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:43.018+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:33:43.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:43.218+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:33:43.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:43.222+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:33:43.623 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:43.622+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:33:43.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:43.626+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:33:44.427 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:44.426+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:33:44.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:44.430+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:33:46.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:46.030+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:33:46.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:46.034+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:33:47.651 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:47.650+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:33:47.652 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:33:47.650+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:33:47.652 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:47.650+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:33:47.653 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:47.650+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4515 cs=1 l=1).handle_message read tag failed 2021-03-09T10:33:47.653 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:47.650+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4515 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:33:49.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:49.234+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:33:49.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:49.238+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:33:52.650 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:33:52.650+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:33:55.641 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:55.642+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:33:55.646 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:33:55.642+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:33:57.650 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:33:57.650+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:34:02.651 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:34:02.650+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:34:07.651 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:34:07.649+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:34:08.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:08.445+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:34:08.459 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:08.457+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:34:12.651 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:34:12.649+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:34:13.019 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:34:13.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:34:13.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:34:13.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000fa20 2021-03-09T10:34:13.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd2000ef30 2021-03-09T10:34:13.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:34:13.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:13.017+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:34:13.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:13.017+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:34:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:13.221+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:34:13.224 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:13.221+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:34:13.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:13.625+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:34:13.628 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:13.625+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:34:14.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:14.429+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:34:14.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:14.429+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:34:16.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:16.033+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:34:16.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:16.033+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:34:17.652 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:34:17.649+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:34:17.652 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:17.649+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:34:17.653 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:17.649+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:34:17.653 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:17.649+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4552 cs=1 l=1).handle_message read tag failed 2021-03-09T10:34:17.653 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:17.649+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4552 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:34:19.237 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:19.237+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:34:19.238 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:19.237+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:34:22.652 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:34:22.649+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:34:25.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:25.641+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:34:25.644 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:25.641+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:34:27.652 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:34:27.649+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:34:32.652 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:34:32.653+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:34:37.653 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:34:37.649+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:34:38.455 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:38.453+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:34:38.456 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:38.453+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:34:42.653 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:34:42.652+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:34:43.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:43.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:34:43.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:43.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:34:43.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:43.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:34:43.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:43.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000fa20 2021-03-09T10:34:43.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:43.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd2000ef30 2021-03-09T10:34:43.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:43.016+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:34:43.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:43.016+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:34:43.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:43.016+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:34:43.220 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:43.220+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:34:43.221 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:43.220+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:34:43.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:43.624+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:34:43.628 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:43.624+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:34:44.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:44.428+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:34:44.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:44.428+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:34:46.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:46.032+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:34:46.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:46.032+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:34:47.653 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:34:47.652+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:34:47.654 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:47.652+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:34:47.654 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:47.652+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:34:47.655 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:47.652+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4585 cs=1 l=1).handle_message read tag failed 2021-03-09T10:34:47.655 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:47.652+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4585 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:34:49.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:49.236+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:34:49.240 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:49.236+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:34:52.653 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:34:52.652+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:34:55.646 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:55.640+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:34:55.646 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:34:55.640+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:34:57.654 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:34:57.652+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:35:02.654 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:35:02.652+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:35:07.654 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:35:07.652+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:35:08.459 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:08.456+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:35:08.459 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:08.460+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:35:12.654 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:35:12.652+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:35:13.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:13.020+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:35:13.020 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:13.020+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:35:13.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:13.020+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:35:13.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:13.020+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003eb0 con 0x7fdd200032a0 2021-03-09T10:35:13.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:13.020+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000ef30 2021-03-09T10:35:13.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:13.020+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:35:13.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:13.020+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:35:13.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:13.020+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:35:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:13.224+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:35:13.224 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:13.224+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:35:13.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:13.628+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:35:13.628 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:13.628+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:35:14.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:14.432+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:35:14.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:14.432+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:35:16.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:16.036+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:35:16.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:16.036+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:35:17.654 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:35:17.652+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:35:17.655 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:17.652+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:35:17.655 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:17.652+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:35:17.656 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:17.652+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4602 cs=1 l=1).handle_message read tag failed 2021-03-09T10:35:17.656 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:17.652+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4602 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:35:19.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:19.240+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:35:19.240 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:19.240+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:35:22.655 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:35:22.655+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:35:25.646 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:25.643+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:35:25.647 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:25.647+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:35:27.655 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:35:27.655+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:35:32.655 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:35:32.655+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:35:37.655 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:35:37.655+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:35:38.456 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:38.455+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:35:38.460 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:38.459+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:35:42.655 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:35:42.655+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:35:43.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:43.019+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:35:43.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:43.019+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:35:43.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:43.019+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:35:43.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:43.019+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200032a0 2021-03-09T10:35:43.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:43.019+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003eb0 con 0x7fdd2000ef30 2021-03-09T10:35:43.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:43.019+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:35:43.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:43.019+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:35:43.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:43.019+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:35:43.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:43.223+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:35:43.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:43.223+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:35:43.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:43.627+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:35:43.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:43.627+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:35:44.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:44.431+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:35:44.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:44.431+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:35:46.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:46.035+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:35:46.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:46.035+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:35:47.656 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:47.655+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:35:47.656 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:47.655+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:35:47.657 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:35:47.655+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:35:47.657 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:47.655+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4619 cs=1 l=1).handle_message read tag failed 2021-03-09T10:35:47.658 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:47.655+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4619 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:35:49.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:49.239+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:35:49.240 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:49.239+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:35:52.656 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:35:52.655+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:35:55.646 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:55.643+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:35:55.646 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:35:55.643+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:35:57.657 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:35:57.655+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:36:02.657 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:36:02.654+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:36:07.657 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:36:07.654+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:36:08.455 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:08.454+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:36:08.458 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:08.454+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:36:12.657 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:36:12.654+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:36:13.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:13.018+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:36:13.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:13.018+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:36:13.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:13.018+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:36:13.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:13.018+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd200032a0 2021-03-09T10:36:13.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:13.018+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000ef30 2021-03-09T10:36:13.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:13.018+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003eb0 con 0x7fdd20006b10 2021-03-09T10:36:13.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:13.018+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:36:13.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:13.018+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:36:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:13.222+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:36:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:13.222+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:36:13.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:13.626+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:36:13.628 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:13.626+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:36:14.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:14.430+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:36:14.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:14.430+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:36:16.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:16.034+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:36:16.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:16.034+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:36:17.657 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:36:17.654+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:36:17.658 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:17.654+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:36:17.658 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:17.654+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:36:17.659 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:17.654+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4636 cs=1 l=1).handle_message read tag failed 2021-03-09T10:36:17.659 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:17.654+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4636 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:36:19.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:19.238+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:36:19.240 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:19.238+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:36:22.658 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:36:22.658+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:36:25.644 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:25.642+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:36:25.644 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:25.642+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:36:27.658 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:36:27.654+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:36:32.658 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:36:32.658+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:36:37.658 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:36:37.653+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:36:38.451 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:38.449+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:36:38.456 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:38.453+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:36:42.658 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:36:42.657+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:36:43.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:43.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:36:43.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:43.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:36:43.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:43.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:36:43.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:43.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T10:36:43.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:43.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd2000fa20 2021-03-09T10:36:43.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:43.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:36:43.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:43.017+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:36:43.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:43.017+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:36:43.222 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:43.221+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:36:43.222 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:43.221+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:36:43.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:43.625+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:36:43.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:43.625+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:36:44.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:44.429+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:36:44.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:44.429+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:36:46.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:46.033+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:36:46.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:46.033+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:36:47.658 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:36:47.653+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:36:47.659 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:47.653+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:36:47.659 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:47.653+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:36:47.660 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:47.653+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4653 cs=1 l=1).handle_message read tag failed 2021-03-09T10:36:47.660 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:47.653+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4653 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:36:49.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:49.237+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:36:49.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:49.237+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:36:52.659 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:36:52.657+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:36:55.646 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:55.645+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:36:55.646 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:36:55.645+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:36:57.659 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:36:57.657+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:37:02.659 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:37:02.657+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:37:07.659 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:37:07.657+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:37:08.459 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:08.457+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:37:08.459 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:08.457+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:37:12.659 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:37:12.657+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:37:13.021 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:37:13.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:37:13.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:37:13.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd20003eb0 2021-03-09T10:37:13.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000fa20 2021-03-09T10:37:13.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:37:13.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:13.017+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:37:13.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:13.017+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:37:13.222 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:13.221+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:37:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:13.221+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:37:13.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:13.625+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:37:13.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:13.625+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:37:14.428 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:14.429+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:37:14.429 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:14.429+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:37:16.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:16.032+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:37:16.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:16.032+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:37:17.660 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:17.656+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:37:17.660 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:17.656+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:37:17.661 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:37:17.656+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:37:17.661 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:17.656+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4670 cs=1 l=1).handle_message read tag failed 2021-03-09T10:37:17.662 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:17.656+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4670 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:37:19.236 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:19.236+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:37:19.238 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:19.236+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:37:22.660 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:37:22.660+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:37:25.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:25.640+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:37:25.645 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:25.640+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:37:27.660 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:37:27.660+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:37:32.661 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:37:32.660+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:37:37.661 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:37:37.660+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:37:38.446 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:38.444+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:37:38.455 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:38.456+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:37:42.661 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:37:42.660+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:37:43.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:43.020+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:37:43.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:43.020+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:37:43.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:43.020+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:37:43.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:43.020+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:37:43.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:43.020+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd2000fa20 2021-03-09T10:37:43.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:43.020+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:37:43.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:43.020+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:37:43.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:43.020+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:37:43.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:43.224+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:37:43.224 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:43.224+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:37:43.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:43.628+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:37:43.628 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:43.628+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:37:44.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:44.432+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:37:44.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:44.432+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:37:46.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:46.036+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:37:46.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:46.036+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:37:47.662 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:47.660+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:37:47.662 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:47.660+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:37:47.663 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:37:47.660+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:37:47.663 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:47.660+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4687 cs=1 l=1).handle_message read tag failed 2021-03-09T10:37:47.664 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:47.660+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4687 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:37:49.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:49.240+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:37:49.240 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:49.240+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:37:52.662 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:37:52.660+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:37:55.646 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:55.643+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:37:55.646 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:37:55.643+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:37:57.662 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:37:57.659+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:38:02.662 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:38:02.659+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:38:07.662 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:38:07.663+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:38:08.452 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:08.451+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:38:08.452 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:08.451+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:38:12.662 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:38:12.663+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:38:13.022 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:13.019+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:38:13.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:13.019+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:38:13.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:13.019+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:38:13.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:13.019+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20003eb0 2021-03-09T10:38:13.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:13.019+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000fa20 2021-03-09T10:38:13.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:13.019+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd20006b10 2021-03-09T10:38:13.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:13.019+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:38:13.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:13.019+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:38:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:13.223+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:38:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:13.223+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:38:13.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:13.627+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:38:13.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:13.627+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:38:14.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:14.431+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:38:14.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:14.431+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:38:16.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:16.035+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:38:16.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:16.035+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:38:17.663 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:38:17.663+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:38:17.663 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:17.663+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:38:17.664 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:17.663+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:38:17.664 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:17.663+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4704 cs=1 l=1).handle_message read tag failed 2021-03-09T10:38:17.664 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:17.663+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4704 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:38:19.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:19.239+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:38:19.240 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:19.239+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:38:22.663 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:38:22.663+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:38:25.646 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:25.647+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:38:25.646 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:25.647+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:38:27.663 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:38:27.663+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:38:32.663 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:38:32.662+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:38:37.663 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:38:37.662+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:38:38.450 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:38.450+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:38:38.451 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:38.450+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:38:42.664 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:38:42.662+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:38:43.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:43.018+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:38:43.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:43.018+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:38:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:43.018+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:38:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:43.018+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:38:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:43.018+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd2000fa20 2021-03-09T10:38:43.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:43.018+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:38:43.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:43.018+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:38:43.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:43.018+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:38:43.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:43.222+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:38:43.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:43.222+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:38:43.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:43.626+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:38:43.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:43.626+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:38:44.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:44.430+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:38:44.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:44.430+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:38:46.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:46.034+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:38:46.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:46.034+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:38:47.664 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:47.662+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:38:47.665 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:47.662+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:38:47.665 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:38:47.662+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:38:47.666 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:47.662+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4721 cs=1 l=1).handle_message read tag failed 2021-03-09T10:38:47.666 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:47.662+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4721 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:38:49.238 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:49.238+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:38:49.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:49.238+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:38:52.664 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:38:52.662+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:38:55.642 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:55.642+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:38:55.645 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:38:55.642+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:38:57.665 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:38:57.662+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:39:02.665 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:39:02.662+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:39:07.665 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:39:07.666+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:39:08.455 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:08.454+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:39:08.458 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:08.454+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:39:12.665 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:39:12.661+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:39:13.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:39:13.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:39:13.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:39:13.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f640 con 0x7fdd20003eb0 2021-03-09T10:39:13.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000fa20 2021-03-09T10:39:13.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:13.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200051e0 con 0x7fdd20006b10 2021-03-09T10:39:13.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:13.017+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:39:13.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:13.021+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:39:13.223 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:13.221+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:39:13.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:13.225+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:39:13.627 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:13.625+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:39:13.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:13.629+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:39:14.431 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:14.429+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:39:14.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:14.433+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:39:16.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:16.033+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:39:16.039 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:16.037+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:39:17.666 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:39:17.665+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:39:17.668 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:17.665+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:39:17.669 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:17.665+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:39:17.669 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:17.665+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4738 cs=1 l=1).handle_message read tag failed 2021-03-09T10:39:17.670 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:17.665+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4738 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:39:19.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:19.237+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:39:19.243 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:19.241+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:39:22.666 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:39:22.665+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:39:25.646 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:25.641+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:39:25.649 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:25.645+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:39:27.667 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:39:27.665+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:39:32.666 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:39:32.665+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:39:37.666 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:39:37.665+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:39:38.459 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:38.457+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:39:38.459 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:38.457+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:39:42.667 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:39:42.665+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:39:43.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:43.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:39:43.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:43.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000fa20 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:39:43.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:43.017+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:39:43.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:43.021+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000f810 2021-03-09T10:39:43.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:43.021+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f640 con 0x7fdd200032a0 2021-03-09T10:39:43.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:43.021+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:39:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:43.021+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:39:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:43.021+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:39:43.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:43.225+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:39:43.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:43.225+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:39:43.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:43.629+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:39:43.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:43.629+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:39:44.432 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:44.433+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:39:44.433 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:44.433+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:39:46.039 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:46.037+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:39:46.039 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:46.037+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:39:47.667 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:39:47.665+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:39:47.668 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:47.665+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:39:47.668 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:47.665+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:39:47.668 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:47.665+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4755 cs=1 l=1).handle_message read tag failed 2021-03-09T10:39:47.669 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:47.665+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4755 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:39:49.241 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:49.240+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:39:49.241 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:49.240+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:39:52.667 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:39:52.664+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:39:55.644 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:55.644+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:39:55.647 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:39:55.644+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:39:57.667 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:39:57.668+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:40:02.668 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:40:02.668+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:40:07.668 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:40:07.668+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:40:08.457 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:08.456+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:40:08.459 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:08.460+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:40:12.668 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:40:12.668+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:40:13.023 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:40:13.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:40:13.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:40:13.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fbf0 con 0x7fdd2000f810 2021-03-09T10:40:13.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:40:13.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f640 con 0x7fdd20006b10 2021-03-09T10:40:13.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:13.024+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:40:13.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:13.024+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:40:13.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:13.228+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:40:13.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:13.228+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:40:13.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:13.632+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:40:13.632 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:13.632+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:40:14.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:14.436+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:40:14.436 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:14.436+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:40:16.039 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:16.040+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:40:16.040 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:16.040+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:40:17.668 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:40:17.668+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:40:17.669 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:17.668+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:40:17.669 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:17.668+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:40:17.669 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:17.668+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4772 cs=1 l=1).handle_message read tag failed 2021-03-09T10:40:17.669 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:17.668+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4772 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:40:19.243 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:19.244+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:40:19.243 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:19.244+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:40:22.668 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:40:22.668+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:40:25.650 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:25.648+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:40:25.651 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:25.648+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:40:27.669 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:40:27.667+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:40:32.669 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:40:32.667+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:40:37.669 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:40:37.667+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:40:38.451 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:38.451+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:40:38.452 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:38.451+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:40:39.109 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:39.107+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd2406cfc0 legacy=0x7fdd2406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-03-09T10:40:39.111 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:39.107+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd2406cfc0 legacy=0x7fdd2406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:40:39.111 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:39.107+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd2406cfc0 0x7fdd2406c7f0 :-1 s=OPENED pgs=131 cs=1 l=1).handle_message read tag failed 2021-03-09T10:40:39.111 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:39.107+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd2406cfc0 0x7fdd2406c7f0 :-1 s=OPENED pgs=131 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:40:39.112 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:39.107+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd2406cfc0 legacy=0x7fdd2406c7f0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting, fault. 2021-03-09T10:40:39.112 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:39.107+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd2406cfc0 legacy=0x7fdd2406c7f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:40:42.669 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:40:42.667+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:40:43.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:43.023+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:40:43.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:43.023+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:40:43.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:43.023+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:40:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:43.023+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000f810 2021-03-09T10:40:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:43.023+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fbf0 con 0x7fdd20003eb0 2021-03-09T10:40:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:43.023+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:40:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:43.023+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:40:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:43.023+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:40:43.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:43.227+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:40:43.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:43.227+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:40:43.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:43.631+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:40:43.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:43.631+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:40:44.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:44.435+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:40:44.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:44.435+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:40:46.039 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:46.039+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:40:46.039 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:46.039+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:40:47.670 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:40:47.667+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:40:47.670 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:47.667+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:40:47.671 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:47.667+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:40:47.671 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:47.667+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4789 cs=1 l=1).handle_message read tag failed 2021-03-09T10:40:47.671 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:47.667+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4789 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:40:49.242 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:49.243+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:40:49.243 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:49.243+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:40:52.670 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:40:52.671+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:40:55.649 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:55.647+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:40:55.650 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:40:55.647+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:40:57.670 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:40:57.671+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:41:02.670 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:41:02.667+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:41:07.670 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:41:07.670+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:41:08.455 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:08.454+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:41:08.462 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:08.458+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:41:12.670 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:41:12.666+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:41:13.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:13.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:41:13.024 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:13.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:41:13.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:13.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:41:13.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:13.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f640 con 0x7fdd2000f810 2021-03-09T10:41:13.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:13.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:41:13.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:13.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fbf0 con 0x7fdd20006b10 2021-03-09T10:41:13.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:13.022+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:41:13.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:13.022+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:41:13.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:13.226+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:41:13.228 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:13.226+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:41:13.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:13.630+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:41:13.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:13.630+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:41:14.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:14.434+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:41:14.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:14.434+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:41:16.039 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:16.038+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:41:16.039 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:16.038+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:41:17.671 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:41:17.670+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:41:17.672 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:17.670+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:41:17.672 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:17.670+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:41:17.672 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:17.670+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4806 cs=1 l=1).handle_message read tag failed 2021-03-09T10:41:17.672 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:17.670+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4806 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:41:19.243 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:19.242+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:41:19.243 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:19.242+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:41:22.671 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:41:22.670+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:41:25.647 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:25.646+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:41:25.649 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:25.646+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:41:27.671 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:41:27.670+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:41:32.672 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:41:32.670+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:41:37.672 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:41:37.670+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:41:38.460 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:38.458+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:41:38.462 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:38.462+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:41:42.672 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:41:42.670+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:41:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:43.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:41:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:43.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:41:43.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:43.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:41:43.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:43.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000f810 2021-03-09T10:41:43.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:43.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f640 con 0x7fdd20003eb0 2021-03-09T10:41:43.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:43.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:41:43.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:43.022+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:41:43.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:43.022+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:41:43.225 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:43.226+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:41:43.225 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:43.226+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:41:43.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:43.629+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:41:43.711 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:43.629+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:41:44.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:44.433+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:41:44.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:44.433+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:41:46.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:46.037+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:41:46.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:46.037+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:41:47.672 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:47.669+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:41:47.673 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:47.669+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:41:47.673 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:47.669+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4823 cs=1 l=1).handle_message read tag failed 2021-03-09T10:41:47.673 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:47.669+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4823 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:41:47.674 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:41:47.669+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:41:49.243 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:49.241+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:41:49.243 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:49.241+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:41:52.673 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:41:52.669+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:41:55.647 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:55.645+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:41:55.649 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:41:55.645+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:41:57.673 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:41:57.669+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:42:02.673 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:42:02.669+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:42:07.673 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:42:07.673+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:42:08.451 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:08.449+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:42:08.462 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:08.457+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:42:12.673 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:42:12.669+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:42:13.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:13.021+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:42:13.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:13.021+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:42:13.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:13.021+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f810 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:42:13.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:13.021+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fbf0 con 0x7fdd200032a0 2021-03-09T10:42:13.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:13.021+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:42:13.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:13.021+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f640 con 0x7fdd20006b10 2021-03-09T10:42:13.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:13.021+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:42:13.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:13.021+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:42:13.225 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:13.225+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:42:13.226 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:13.225+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:42:13.630 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:13.629+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:42:13.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:13.629+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:42:14.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:14.433+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:42:14.542 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:14.433+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:42:16.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:16.037+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:42:16.121 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:16.037+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:42:17.674 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:17.673+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:42:17.674 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:17.673+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:42:17.675 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:17.673+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4840 cs=1 l=1).handle_message read tag failed 2021-03-09T10:42:17.675 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:17.673+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4840 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:42:17.675 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:42:17.673+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:42:19.243 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:19.241+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:42:19.243 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:19.241+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:42:22.674 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:42:22.672+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:42:25.650 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:25.648+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:42:25.650 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:25.648+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:42:27.674 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:42:27.672+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:42:32.674 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:42:32.668+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:42:37.675 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:42:37.668+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:42:38.458 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:38.456+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:42:38.459 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:38.456+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:42:42.675 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:42:42.676+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:42:43.025 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:43.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:42:43.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:43.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:42:43.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:43.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:42:43.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:43.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000ef30 2021-03-09T10:42:43.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:43.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fbf0 con 0x7fdd20003eb0 2021-03-09T10:42:43.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:43.024+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:42:43.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:43.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:42:43.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:43.024+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:42:43.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:43.228+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:42:43.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:43.228+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:42:43.632 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:43.632+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:42:43.633 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:43.632+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:42:44.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:44.436+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:42:44.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:44.436+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:42:46.039 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:46.040+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:42:46.039 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:46.040+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:42:47.675 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:42:47.676+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:42:47.676 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:47.676+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:42:47.676 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:47.676+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:42:47.676 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:47.676+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4857 cs=1 l=1).handle_message read tag failed 2021-03-09T10:42:47.677 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:47.676+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4857 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:42:49.243 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:49.244+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:42:49.243 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:49.244+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:42:52.675 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:42:52.676+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:42:55.650 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:55.648+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:42:55.650 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:42:55.648+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:42:57.675 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:42:57.676+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:43:02.676 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:43:02.675+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:43:07.676 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:43:07.675+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:43:08.463 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:08.463+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:43:08.463 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:08.463+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:43:12.676 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:43:12.675+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:43:13.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:13.023+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:43:13.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:13.023+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:43:13.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:13.023+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:43:13.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:13.023+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fa20 con 0x7fdd2000ef30 2021-03-09T10:43:13.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:13.023+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:43:13.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:13.023+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fbf0 con 0x7fdd20006b10 2021-03-09T10:43:13.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:13.023+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:43:13.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:13.023+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:43:13.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:13.227+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:43:13.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:13.227+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:43:13.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:13.631+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:43:13.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:13.631+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:43:14.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:14.435+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:43:14.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:14.435+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:43:16.039 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:16.039+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:43:16.039 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:16.039+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:43:17.676 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:17.675+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:43:17.677 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:17.675+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:43:17.677 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:17.675+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4874 cs=1 l=1).handle_message read tag failed 2021-03-09T10:43:17.677 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:17.675+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4874 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:43:17.678 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:43:17.675+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:43:19.242 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:19.243+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:43:19.243 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:19.243+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:43:22.677 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:43:22.675+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:43:25.648 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:25.647+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:43:25.649 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:25.647+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:43:27.677 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:43:27.675+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:43:32.677 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:43:32.675+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:43:37.677 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:43:37.675+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:43:38.461 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:38.459+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:43:38.462 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:38.459+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:43:42.677 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:43:42.678+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:43:43.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:43.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:43:43.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:43.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:43:43.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:43.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:43:43.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:43.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000ef30 2021-03-09T10:43:43.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:43.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fa20 con 0x7fdd200032a0 2021-03-09T10:43:43.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:43.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:43:43.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:43.022+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:43:43.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:43.022+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:43:43.226 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:43.226+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:43:43.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:43.226+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:43:43.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:43.630+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:43:43.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:43.630+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:43:44.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:44.434+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:43:44.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:44.434+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:43:46.039 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:46.038+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:43:46.040 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:46.038+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:43:47.678 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:43:47.678+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:43:47.678 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:47.678+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:43:47.679 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:47.678+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:43:47.679 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:47.678+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4891 cs=1 l=1).handle_message read tag failed 2021-03-09T10:43:47.679 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:47.678+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4891 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:43:49.243 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:49.242+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:43:49.243 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:49.242+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:43:52.678 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:43:52.678+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:43:55.650 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:55.650+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:43:55.650 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:43:55.650+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:43:57.678 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:43:57.678+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:44:02.679 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:44:02.678+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:44:07.678 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:44:07.678+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:44:08.455 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:08.454+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:44:08.455 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:08.454+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:44:12.679 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:44:12.678+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:44:13.026 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:13.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:44:13.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:13.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:44:13.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:13.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000f310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:44:13.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:13.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fbd0 con 0x7fdd20003eb0 2021-03-09T10:44:13.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:13.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200032a0 2021-03-09T10:44:13.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:13.022+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fa20 con 0x7fdd20006b10 2021-03-09T10:44:13.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:13.022+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:44:13.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:13.022+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:44:13.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:13.226+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:44:13.227 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:13.226+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:44:13.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:13.630+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:44:13.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:13.630+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:44:14.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:14.434+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:44:14.435 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:14.434+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:44:16.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:16.038+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:44:16.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:16.038+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:44:17.679 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:44:17.677+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:44:17.680 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:17.677+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:44:17.680 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:17.677+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:44:17.681 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:17.677+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4908 cs=1 l=1).handle_message read tag failed 2021-03-09T10:44:17.681 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:17.677+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4908 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:44:19.241 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:19.241+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:44:19.241 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:19.241+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:44:22.679 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:44:22.677+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:44:25.647 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:25.645+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:44:25.667 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:25.645+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:44:27.679 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:44:27.677+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:44:32.680 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:44:32.681+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:44:37.680 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:44:37.681+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:44:38.460 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:38.461+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:44:38.461 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:38.461+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:44:42.680 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:44:42.681+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:44:43.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:43.021+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:44:43.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:43.021+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:44:43.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:43.021+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:44:43.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:43.021+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:44:43.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:43.021+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fbd0 con 0x7fdd200032a0 2021-03-09T10:44:43.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:43.021+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:44:43.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:43.025+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:44:43.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:43.025+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:44:43.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:43.229+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:44:43.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:43.229+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:44:43.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:43.633+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:44:43.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:43.633+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:44:44.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:44.437+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:44:44.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:44.437+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:44:46.041 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:46.041+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:44:46.041 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:46.041+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:44:47.681 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:44:47.681+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:44:47.681 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:47.681+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:44:47.682 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:47.681+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:44:47.682 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:47.681+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4929 cs=1 l=1).handle_message read tag failed 2021-03-09T10:44:47.682 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:47.681+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4929 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:44:49.244 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:49.245+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:44:49.246 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:49.245+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:44:52.681 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:44:52.681+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:44:55.651 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:55.648+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:44:55.653 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:44:55.648+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:44:57.681 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:44:57.680+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:45:02.681 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:45:02.680+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:45:07.682 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:45:07.680+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:45:08.455 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:08.452+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:45:08.466 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:08.460+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:45:12.682 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:45:12.680+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:45:13.027 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:45:13.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:45:13.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:45:13.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd20003eb0 2021-03-09T10:45:13.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T10:45:13.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000fbd0 con 0x7fdd20006b10 2021-03-09T10:45:13.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:13.024+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:45:13.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:13.024+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:45:13.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:13.228+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:45:13.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:13.228+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:45:13.631 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:13.632+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:45:13.632 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:13.632+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:45:14.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:14.436+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:45:14.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:14.436+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:45:16.043 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:16.040+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:45:16.043 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:16.040+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:45:17.683 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:17.680+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:45:17.683 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:17.680+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:45:17.684 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:45:17.680+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:45:17.684 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:17.680+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4966 cs=1 l=1).handle_message read tag failed 2021-03-09T10:45:17.684 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:17.680+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=4966 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:45:19.243 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:19.244+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:45:19.246 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:19.244+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:45:22.683 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:45:22.684+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:45:25.649 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:25.648+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:45:25.653 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:25.652+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:45:27.683 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:45:27.684+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:45:32.683 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:45:32.684+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:45:37.684 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:45:37.683+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:45:38.463 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:38.459+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:45:38.463 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:38.459+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:45:42.684 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:45:42.683+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:45:43.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:43.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:45:43.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:43.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:45:43.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:43.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:45:43.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:43.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:45:43.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:43.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd200032a0 2021-03-09T10:45:43.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:43.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:45:43.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:43.027+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:45:43.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:43.027+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:45:43.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:43.231+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:45:43.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:43.231+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:45:43.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:43.635+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:45:43.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:43.635+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:45:44.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:44.439+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:45:44.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:44.439+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:45:46.043 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:46.043+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:45:46.043 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:46.043+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:45:47.685 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:47.683+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:45:47.685 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:47.683+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:45:47.685 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:47.683+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=5003 cs=1 l=1).handle_message read tag failed 2021-03-09T10:45:47.686 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:47.683+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd200103e0 :-1 s=OPENED pgs=5003 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:45:47.686 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:45:47.683+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:45:49.247 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:49.247+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:45:49.247 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:49.247+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:45:52.685 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:45:52.683+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:45:55.654 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:55.651+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:45:55.655 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:45:55.651+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:45:57.685 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:45:57.683+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:46:02.686 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:46:02.683+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:46:07.686 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:46:07.687+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:46:08.467 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:08.467+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:46:08.467 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:08.467+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:46:12.686 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:46:12.686+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:46:13.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:13.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:46:13.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:13.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:46:13.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:13.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:46:13.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:13.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f640 con 0x7fdd20003eb0 2021-03-09T10:46:13.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:13.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000f850 2021-03-09T10:46:13.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:13.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd20006b10 2021-03-09T10:46:13.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:13.026+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:46:13.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:13.026+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:46:13.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:13.230+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:46:13.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:13.230+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:46:13.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:13.634+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:46:13.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:13.634+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:46:14.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:14.438+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:46:14.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:14.438+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:46:16.043 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:16.042+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:46:16.043 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:16.042+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:46:17.687 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:17.686+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:46:17.687 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:17.686+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:46:17.687 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:17.686+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000ef30 :-1 s=OPENED pgs=5036 cs=1 l=1).handle_message read tag failed 2021-03-09T10:46:17.688 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:17.686+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000ef30 :-1 s=OPENED pgs=5036 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:46:17.688 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:46:17.686+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:46:19.247 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:19.246+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:46:19.247 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:19.246+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:46:22.687 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:46:22.686+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:46:25.651 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:25.650+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:46:25.651 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:25.650+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:46:27.687 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:46:27.686+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:46:32.687 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:46:32.686+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:46:37.687 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:46:37.686+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:46:38.464 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:38.462+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:46:38.464 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:38.462+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:46:42.688 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:46:42.686+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:46:43.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:43.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:46:43.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:43.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:46:43.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:43.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:46:43.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:43.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T10:46:43.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:43.026+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:46:43.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:43.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f640 con 0x7fdd2000f850 2021-03-09T10:46:43.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:43.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:46:43.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:43.026+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:46:43.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:43.230+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:46:43.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:43.230+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:46:43.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:43.634+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:46:43.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:43.634+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:46:44.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:44.438+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:46:44.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:44.438+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:46:46.043 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:46.042+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:46:46.043 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:46.042+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:46:47.688 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:46:47.686+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:46:47.689 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:47.686+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:46:47.689 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:47.686+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:46:47.689 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:47.686+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000ef30 :-1 s=OPENED pgs=5053 cs=1 l=1).handle_message read tag failed 2021-03-09T10:46:47.689 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:47.686+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000ef30 :-1 s=OPENED pgs=5053 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:46:49.247 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:49.246+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:46:49.247 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:49.246+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:46:52.688 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:46:52.689+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:46:55.653 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:55.653+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:46:55.654 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:46:55.653+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:46:57.689 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:46:57.689+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:47:02.689 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:47:02.689+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:47:07.689 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:47:07.689+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:47:08.467 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:08.465+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:47:08.467 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:08.465+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:47:12.689 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:47:12.689+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:47:13.028 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:13.025+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:47:13.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:13.025+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:47:13.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:13.025+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:47:13.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:13.025+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd200032a0 2021-03-09T10:47:13.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:13.025+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:47:13.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:13.025+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f640 con 0x7fdd20006b10 2021-03-09T10:47:13.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:13.025+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:47:13.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:13.025+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:47:13.229 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:13.229+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:47:13.229 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:13.229+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:47:13.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:13.633+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:47:13.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:13.633+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:47:14.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:14.437+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:47:14.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:14.437+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:47:16.041 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:16.041+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:47:16.042 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:16.041+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:47:17.689 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:47:17.685+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:47:17.690 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:17.685+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:47:17.690 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:17.685+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:47:17.691 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:17.685+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5070 cs=1 l=1).handle_message read tag failed 2021-03-09T10:47:17.691 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:17.685+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5070 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:47:19.244 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:19.245+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:47:19.245 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:19.245+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:47:22.690 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:47:22.689+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:47:25.651 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:25.649+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:47:25.652 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:25.649+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:47:27.690 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:47:27.689+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:47:32.690 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:47:32.688+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:47:37.690 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:47:37.688+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:47:38.465 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:38.464+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:47:38.465 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:38.464+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:47:42.690 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:47:42.688+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:47:43.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:43.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:47:43.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:43.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:47:43.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:43.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:47:43.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:43.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200032a0 2021-03-09T10:47:43.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:43.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd20003eb0 2021-03-09T10:47:43.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:43.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:47:43.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:43.024+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:47:43.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:43.024+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:47:43.229 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:43.228+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:47:43.230 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:43.228+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:47:43.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:43.632+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:47:43.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:43.632+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:47:44.436 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:44.436+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:47:44.436 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:44.436+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:47:46.043 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:46.040+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:47:46.043 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:46.040+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:47:47.691 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:47:47.688+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:47:47.691 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:47.688+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:47:47.692 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:47.688+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:47:47.692 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:47.688+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5087 cs=1 l=1).handle_message read tag failed 2021-03-09T10:47:47.692 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:47.688+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5087 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:47:49.247 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:49.244+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:47:49.247 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:49.244+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:47:52.691 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:47:52.692+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:47:55.651 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:55.652+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:47:55.651 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:47:55.652+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:47:57.691 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:47:57.692+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:48:02.691 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:48:02.692+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:48:07.692 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:48:07.692+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:48:08.464 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:08.463+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:48:08.464 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:08.463+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:48:12.692 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:48:12.691+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:48:13.029 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:13.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:48:13.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:13.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:48:13.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:13.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:48:13.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:13.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f640 con 0x7fdd200032a0 2021-03-09T10:48:13.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:13.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000f850 2021-03-09T10:48:13.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:13.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd20006b10 2021-03-09T10:48:13.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:13.027+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:48:13.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:13.027+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:48:13.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:13.231+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:48:13.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:13.231+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:48:13.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:13.635+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:48:13.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:13.635+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:48:14.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:14.439+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:48:14.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:14.439+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:48:16.043 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:16.043+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:48:16.043 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:16.043+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:48:17.692 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:48:17.691+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:48:17.693 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:17.691+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:48:17.693 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:17.691+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:48:17.694 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:17.691+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5104 cs=1 l=1).handle_message read tag failed 2021-03-09T10:48:17.694 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:17.691+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5104 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:48:19.246 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:19.247+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:48:19.247 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:19.247+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:48:22.695 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:48:22.691+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:48:25.653 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:25.651+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:48:25.654 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:25.651+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:48:27.693 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:48:27.691+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:48:32.693 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:48:32.691+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:48:37.693 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:48:37.691+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:48:38.466 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:38.467+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:48:38.467 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:38.467+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:48:42.693 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:48:42.691+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:48:43.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:43.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:48:43.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:43.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:48:43.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:43.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:48:43.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:43.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T10:48:43.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:43.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f640 con 0x7fdd2000f850 2021-03-09T10:48:43.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:43.027+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:48:43.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:43.027+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:48:43.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:43.027+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:48:43.230 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:43.231+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:48:43.230 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:43.231+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:48:43.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:43.635+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:48:43.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:43.635+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:48:44.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:44.439+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:48:44.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:44.439+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:48:46.043 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:46.042+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:48:46.043 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:46.042+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:48:47.693 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:48:47.690+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:48:47.694 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:47.690+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:48:47.695 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:47.690+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:48:47.695 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:47.690+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5121 cs=1 l=1).handle_message read tag failed 2021-03-09T10:48:47.695 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:47.690+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5121 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:48:49.247 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:49.246+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:48:49.248 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:49.246+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:48:52.694 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:48:52.694+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:48:55.654 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:55.654+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:48:55.654 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:48:55.654+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:48:57.694 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:48:57.690+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:49:02.694 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:49:02.694+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:49:07.694 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:49:07.694+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:49:08.457 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:08.458+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:49:08.467 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:08.466+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:49:12.694 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:49:12.694+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:49:13.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:13.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:49:13.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:13.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:49:13.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:13.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:49:13.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:13.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd200032a0 2021-03-09T10:49:13.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:13.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:49:13.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:13.026+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f640 con 0x7fdd20006b10 2021-03-09T10:49:13.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:13.026+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:49:13.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:13.026+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:49:13.230 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:13.230+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:49:13.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:13.230+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:49:13.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:13.634+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:49:13.636 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:13.634+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:49:14.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:14.438+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:49:14.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:14.438+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:49:16.041 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:16.042+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:49:16.041 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:16.042+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:49:17.695 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:49:17.694+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:49:17.696 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:17.694+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:49:17.696 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:17.694+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:49:17.696 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:17.694+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5138 cs=1 l=1).handle_message read tag failed 2021-03-09T10:49:17.696 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:17.694+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5138 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:49:19.247 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:19.246+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:49:19.247 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:19.246+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:49:22.695 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:49:22.693+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:49:25.653 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:25.653+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:49:25.654 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:25.653+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:49:27.696 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:49:27.693+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:49:32.696 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:49:32.693+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:49:37.696 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:49:37.693+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:49:38.457 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:38.457+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:49:38.466 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:38.465+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:49:42.696 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:49:42.693+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:49:43.030 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:43.025+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:49:43.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:43.025+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:49:43.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:43.025+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:49:43.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:43.025+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000f850 2021-03-09T10:49:43.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:43.025+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd20003eb0 2021-03-09T10:49:43.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:43.025+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:49:43.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:43.025+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:49:43.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:43.025+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:49:43.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:43.229+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:49:43.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:43.229+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:49:43.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:43.633+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:49:43.635 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:43.633+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:49:44.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:44.437+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:49:44.439 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:44.437+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:49:46.041 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:46.041+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:49:46.041 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:46.041+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:49:47.696 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:49:47.697+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:49:47.697 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:47.697+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:49:47.697 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:47.697+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:49:47.698 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:47.697+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5155 cs=1 l=1).handle_message read tag failed 2021-03-09T10:49:47.698 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:47.697+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5155 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:49:49.245 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:49.245+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:49:49.245 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:49.245+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:49:52.697 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:49:52.693+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:49:55.652 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:55.649+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:49:55.652 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:49:55.649+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:49:57.697 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:49:57.697+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:50:02.697 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:50:02.696+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:50:07.697 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:50:07.692+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:50:08.465 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:08.464+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:50:08.465 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:08.464+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:50:12.697 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:50:12.696+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:50:13.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:50:13.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:50:13.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:50:13.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200032a0 con 0x7fdd2000f850 2021-03-09T10:50:13.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000ef30 2021-03-09T10:50:13.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:13.024+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:50:13.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:13.024+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd20006b10 2021-03-09T10:50:13.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:13.028+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:50:13.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:13.232+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:50:13.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:13.232+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:50:13.636 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:13.636+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:50:13.636 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:13.636+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:50:14.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:14.440+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:50:14.445 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:14.440+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:50:16.047 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:16.044+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:50:16.047 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:16.044+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:50:17.698 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:17.696+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:50:17.698 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:17.696+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:50:17.698 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:17.696+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5172 cs=1 l=1).handle_message read tag failed 2021-03-09T10:50:17.699 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:17.696+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5172 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:50:17.699 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:50:17.696+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:50:19.248 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:19.248+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:50:19.250 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:19.248+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:50:22.698 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:50:22.696+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:50:25.654 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:25.652+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:50:25.656 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:25.656+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:50:27.698 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:50:27.696+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:50:32.698 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:50:32.700+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:50:37.698 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:50:37.699+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:50:38.468 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:38.467+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:50:38.469 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:38.467+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:50:42.698 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:50:42.699+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:50:43.031 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:43.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:50:43.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:43.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:50:43.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:43.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:50:43.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:43.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:50:43.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:43.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200032a0 con 0x7fdd2000ef30 2021-03-09T10:50:43.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:43.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:50:43.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:43.031+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:50:43.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:43.031+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:50:43.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:43.235+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:50:43.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:43.235+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:50:43.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:43.639+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:50:43.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:43.639+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:50:44.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:44.443+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:50:44.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:44.443+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:50:46.047 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:46.047+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:50:46.047 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:46.047+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:50:47.699 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:50:47.699+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:50:47.700 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:47.699+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:50:47.700 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:47.699+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:50:47.701 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:47.699+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5189 cs=1 l=1).handle_message read tag failed 2021-03-09T10:50:47.701 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:47.699+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5189 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:50:49.251 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:49.251+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:50:49.251 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:49.251+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:50:52.699 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:50:52.699+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:50:55.655 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:55.655+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:50:55.655 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:50:55.655+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:50:57.699 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:50:57.699+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:51:02.700 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:51:02.699+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:51:07.700 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:51:07.699+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:51:08.463 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:08.463+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:51:08.463 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:08.463+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:51:12.700 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:51:12.698+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:51:13.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:13.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:51:13.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:13.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:51:13.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:13.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:51:13.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:13.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f310 con 0x7fdd2000f850 2021-03-09T10:51:13.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:13.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000ef30 2021-03-09T10:51:13.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:13.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200032a0 con 0x7fdd20006b10 2021-03-09T10:51:13.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:13.030+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:51:13.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:13.030+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:51:13.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:13.234+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:51:13.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:13.234+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:51:13.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:13.638+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:51:13.640 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:13.638+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:51:14.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:14.442+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:51:14.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:14.442+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:51:16.047 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:16.046+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:51:16.047 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:16.046+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:51:17.700 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:51:17.698+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:51:17.701 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:17.698+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:51:17.701 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:17.698+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:51:17.702 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:17.698+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5206 cs=1 l=1).handle_message read tag failed 2021-03-09T10:51:17.702 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:17.698+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5206 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:51:19.251 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:19.250+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:51:19.251 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:19.250+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:51:22.701 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:51:22.698+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:51:25.658 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:25.658+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:51:25.658 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:25.658+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:51:27.701 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:51:27.698+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:51:32.701 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:51:32.702+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:51:37.701 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:51:37.698+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:51:38.464 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:38.462+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:51:38.465 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:38.462+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:51:42.701 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:51:42.702+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:51:43.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:43.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:51:43.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:43.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:51:43.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:43.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20008610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:51:43.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:43.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:51:43.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:43.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f310 con 0x7fdd2000ef30 2021-03-09T10:51:43.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:43.030+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:51:43.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:43.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:51:43.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:43.030+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:51:43.232 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:43.234+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:51:43.233 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:43.234+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:51:43.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:43.638+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:51:43.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:43.638+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:51:44.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:44.442+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:51:44.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:44.442+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:51:46.045 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:46.046+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:51:46.045 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:46.046+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:51:47.702 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:51:47.702+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:51:47.702 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:47.702+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:51:47.703 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:47.702+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:51:47.703 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:47.702+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5223 cs=1 l=1).handle_message read tag failed 2021-03-09T10:51:47.703 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:47.702+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5223 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:51:49.249 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:49.249+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:51:49.249 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:49.249+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:51:52.702 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:51:52.697+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:51:55.655 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:55.653+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:51:55.656 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:51:55.653+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:51:57.702 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:51:57.701+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:52:02.703 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:52:02.701+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:52:07.703 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:52:07.701+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:52:08.465 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:08.465+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:52:08.465 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:08.465+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:52:12.703 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:52:12.701+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:52:13.032 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:13.029+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:52:13.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:13.029+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:52:13.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:13.029+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20007f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:52:13.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:13.029+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f4c0 con 0x7fdd20003eb0 2021-03-09T10:52:13.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:13.029+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000ef30 2021-03-09T10:52:13.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:13.029+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f310 con 0x7fdd20006b10 2021-03-09T10:52:13.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:13.029+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:52:13.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:13.029+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:52:13.233 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:13.233+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:52:13.233 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:13.233+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:52:13.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:13.637+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:52:13.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:13.637+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:52:14.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:14.441+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:52:14.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:14.441+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:52:16.045 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:16.045+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:52:16.045 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:16.045+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:52:17.703 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:52:17.701+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:52:17.704 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:17.701+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:52:17.704 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:17.701+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:52:17.705 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:17.701+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5240 cs=1 l=1).handle_message read tag failed 2021-03-09T10:52:17.705 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:17.701+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5240 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:52:19.249 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:19.249+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:52:19.249 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:19.249+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:52:22.703 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:52:22.701+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:52:25.656 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:25.657+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:52:25.656 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:25.657+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:52:27.704 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:52:27.704+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:52:32.704 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:52:32.700+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:52:37.704 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:52:37.704+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:52:38.469 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:38.464+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:52:38.469 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:38.464+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:52:42.704 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:52:42.700+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:52:43.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:43.028+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:52:43.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:43.028+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:52:43.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:43.028+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:52:43.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:43.028+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd2000f850 2021-03-09T10:52:43.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:43.028+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f4c0 con 0x7fdd200032a0 2021-03-09T10:52:43.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:43.028+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:52:43.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:43.028+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:52:43.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:43.028+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001c6a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:52:43.233 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:43.232+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001c6a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:52:43.234 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:43.232+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:52:43.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:43.636+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:52:43.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:43.636+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001c6a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:52:44.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:44.440+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:52:44.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:44.440+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001c6a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:52:46.045 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:46.044+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:52:46.045 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:46.044+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001c6a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:52:47.705 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:52:47.704+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:52:47.705 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:47.704+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:52:47.706 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:47.704+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:52:47.706 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:47.704+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5257 cs=1 l=1).handle_message read tag failed 2021-03-09T10:52:47.706 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:47.704+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5257 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:52:49.247 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:49.248+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:52:49.247 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:49.248+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001c6a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:52:52.705 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:52:52.704+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:52:55.653 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:55.652+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:52:55.654 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:52:55.652+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001c6a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:52:57.705 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:52:57.704+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:53:02.705 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:53:02.704+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:53:07.705 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:53:07.703+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:53:08.466 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:08.467+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:53:08.467 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:08.467+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001c6a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:53:12.706 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:53:12.703+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:53:13.033 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:13.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:53:13.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:13.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2001c6a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:53:13.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:13.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20018f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:53:13.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:13.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003700 con 0x7fdd2000f850 2021-03-09T10:53:13.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:13.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:53:13.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:13.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f4c0 con 0x7fdd20006b10 2021-03-09T10:53:13.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:13.031+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:53:13.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:13.031+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:53:13.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:13.235+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:53:13.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:13.235+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:53:13.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:13.639+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:53:13.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:13.639+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:53:14.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:14.443+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:53:14.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:14.443+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:53:16.047 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:16.047+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:53:16.047 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:16.047+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:53:17.706 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:17.703+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:53:17.707 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:17.703+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:53:17.707 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:53:17.703+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:53:17.707 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:17.703+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5274 cs=1 l=1).handle_message read tag failed 2021-03-09T10:53:17.708 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:17.703+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5274 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:53:19.250 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:19.251+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:53:19.251 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:19.251+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:53:22.707 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:53:22.707+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:53:25.658 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:25.655+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:53:25.658 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:25.655+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:53:27.707 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:53:27.703+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:53:32.707 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:53:32.707+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:53:37.707 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:53:37.707+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:53:38.463 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:38.463+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:53:38.464 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:38.463+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:53:42.707 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:53:42.706+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:53:43.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:43.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:53:43.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:43.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:53:43.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:43.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd20015840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:53:43.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:43.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000f850 2021-03-09T10:53:43.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:43.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003700 con 0x7fdd20003eb0 2021-03-09T10:53:43.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:43.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:53:43.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:43.030+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:53:43.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:43.030+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:53:43.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:43.234+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:53:43.240 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:43.234+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:53:43.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:43.638+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:53:43.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:43.638+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:53:44.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:44.442+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:53:44.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:44.442+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:53:46.047 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:46.046+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:53:46.047 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:46.046+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:53:47.708 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:53:47.706+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:53:47.708 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:47.706+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:53:47.709 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:47.706+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:53:47.709 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:47.706+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5291 cs=1 l=1).handle_message read tag failed 2021-03-09T10:53:47.709 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:47.706+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5291 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:53:49.251 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:49.250+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:53:49.251 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:49.250+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:53:52.708 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:53:52.706+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:53:55.657 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:55.658+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:53:55.658 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:53:55.658+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:53:57.708 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:53:57.706+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:54:02.708 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:54:02.706+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:54:07.708 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:54:07.706+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:54:08.463 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:08.462+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:54:08.470 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:08.466+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:54:12.709 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:54:12.710+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:54:13.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:13.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:54:13.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:13.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:54:13.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:13.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:54:13.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:13.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f640 con 0x7fdd2000f850 2021-03-09T10:54:13.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:13.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:54:13.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:13.030+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003700 con 0x7fdd20006b10 2021-03-09T10:54:13.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:13.030+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:54:13.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:13.030+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:54:13.234 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:13.234+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:54:13.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:13.234+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:54:13.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:13.638+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:54:13.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:13.638+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:54:14.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:14.442+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:54:14.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:14.442+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:54:16.047 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:16.046+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:54:16.047 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:16.046+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:54:17.709 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:54:17.709+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:54:17.710 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:17.709+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:54:17.710 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:17.709+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:54:17.710 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:17.709+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5308 cs=1 l=1).handle_message read tag failed 2021-03-09T10:54:17.710 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:17.709+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5308 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:54:19.251 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:19.249+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:54:19.251 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:19.249+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:54:22.709 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:54:22.709+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:54:25.658 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:25.657+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:54:25.658 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:25.657+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:54:27.709 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:54:27.709+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:54:32.710 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:54:32.709+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:54:37.710 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:54:37.709+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:54:38.471 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:38.469+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:54:38.471 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:38.469+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:54:42.710 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:54:42.709+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:54:43.034 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:43.029+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:54:43.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:43.029+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:54:43.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:43.029+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:54:43.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:43.029+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T10:54:43.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:43.029+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f640 con 0x7fdd20003eb0 2021-03-09T10:54:43.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:43.029+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:54:43.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:43.029+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:54:43.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:43.029+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:54:43.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:43.233+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:54:43.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:43.233+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:54:43.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:43.637+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:54:43.640 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:43.637+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:54:44.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:44.441+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:54:44.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:44.441+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:54:46.045 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:46.045+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:54:46.045 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:46.045+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:54:47.710 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:54:47.705+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:54:47.711 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:47.705+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:54:47.711 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:47.705+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:54:47.711 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:47.705+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5325 cs=1 l=1).handle_message read tag failed 2021-03-09T10:54:47.712 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:47.705+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5325 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:54:49.248 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:49.249+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:54:49.251 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:49.249+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:54:52.711 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:54:52.709+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:54:55.655 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:55.652+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:54:55.656 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:54:55.652+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:54:57.711 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:54:57.708+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:55:02.711 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:55:02.708+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:55:07.711 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:55:07.712+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:55:08.469 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:08.468+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:55:08.469 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:08.468+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:55:12.711 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:55:12.712+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:55:13.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:13.028+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:55:13.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:13.028+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:55:13.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:13.028+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd20018860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:55:13.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:13.028+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200036c0 con 0x7fdd2000f850 2021-03-09T10:55:13.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:13.028+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:55:13.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:13.028+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f640 con 0x7fdd20006b10 2021-03-09T10:55:13.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:13.028+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:55:13.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:13.028+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:55:13.231 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:13.232+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:55:13.235 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:13.232+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:55:13.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:13.636+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:55:13.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:13.636+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:55:14.440 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:14.440+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:55:14.440 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:14.440+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:55:16.043 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:16.044+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:55:16.043 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:16.044+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:55:17.712 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:55:17.712+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:55:17.713 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:17.712+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:55:17.713 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:17.712+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:55:17.713 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:17.712+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5342 cs=1 l=1).handle_message read tag failed 2021-03-09T10:55:17.713 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:17.712+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5342 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:55:19.247 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:19.248+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:55:19.247 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:19.248+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:55:22.712 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:55:22.712+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:55:25.654 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:25.652+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:55:25.654 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:25.652+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:55:27.712 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:55:27.712+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:55:32.712 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:55:32.711+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:55:37.712 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:55:37.711+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:55:38.467 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:38.467+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:55:38.467 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:38.467+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:55:39.107 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:39.107+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-03-09T10:55:39.108 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:39.107+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:55:39.108 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:39.107+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 0x7fdd2405b9f0 :-1 s=OPENED pgs=150 cs=1 l=1).handle_message read tag failed 2021-03-09T10:55:39.108 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:39.107+0000 7fdd43fff700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 0x7fdd2405b9f0 :-1 s=OPENED pgs=150 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:55:39.108 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:39.107+0000 7fdd43fff700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405b9f0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting, fault. 2021-03-09T10:55:39.108 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:39.107+0000 7fdd40ff9700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6816/17701 conn(0x7fdd240595d0 legacy=0x7fdd2405b9f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:55:42.713 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:55:42.711+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:55:43.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:43.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:55:43.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:43.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000ef30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:55:43.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:43.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd2000f850 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:55:43.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:43.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd200032a0 2021-03-09T10:55:43.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:43.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200036c0 con 0x7fdd20003eb0 2021-03-09T10:55:43.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:43.031+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:55:43.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:43.031+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:55:43.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:43.035+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:55:43.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:43.239+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:55:43.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:43.239+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:55:43.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:43.643+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:55:43.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:43.643+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:55:44.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:44.447+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:55:44.448 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:44.447+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:55:46.051 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:46.051+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:55:46.051 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:46.051+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:55:47.713 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:55:47.711+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:55:47.714 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:47.711+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:55:47.714 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:47.711+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:55:47.714 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:47.711+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5359 cs=1 l=1).handle_message read tag failed 2021-03-09T10:55:47.714 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:47.711+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5359 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:55:49.255 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:49.255+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:55:49.255 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:49.255+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:55:52.713 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:55:52.711+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:55:55.662 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:55.659+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:55:55.662 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:55:55.659+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:55:57.713 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:55:57.711+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:56:02.714 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:56:02.715+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:56:07.714 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:56:07.715+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:56:08.468 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:08.467+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:56:08.475 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:08.475+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:56:12.714 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:56:12.714+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:56:13.035 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:13.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:56:13.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:13.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:56:13.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:13.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:56:13.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:13.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f850 con 0x7fdd200032a0 2021-03-09T10:56:13.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:13.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000ef30 2021-03-09T10:56:13.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:13.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200036c0 con 0x7fdd20006b10 2021-03-09T10:56:13.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:13.034+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:56:13.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:13.034+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:56:13.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:13.238+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:56:13.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:13.238+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:56:13.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:13.642+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:56:13.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:13.642+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:56:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:14.446+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:56:14.448 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:14.446+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:56:16.051 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:16.050+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:56:16.051 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:16.050+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:56:17.714 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:56:17.714+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:56:17.715 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:17.714+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:56:17.715 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:17.714+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:56:17.716 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:17.714+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5380 cs=1 l=1).handle_message read tag failed 2021-03-09T10:56:17.716 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:17.714+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5380 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:56:19.255 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:19.254+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:56:19.255 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:19.254+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:56:22.715 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:56:22.714+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:56:25.661 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:25.658+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:56:25.661 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:25.658+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:56:27.715 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:56:27.714+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:56:32.716 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:56:32.714+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:56:37.715 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:56:37.714+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:56:38.469 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:38.470+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:56:38.475 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:38.474+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:56:42.716 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:56:42.714+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:56:43.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:43.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:56:43.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:43.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:56:43.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:43.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:56:43.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:43.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c5e0 con 0x7fdd200032a0 2021-03-09T10:56:43.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:43.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f850 con 0x7fdd2000ef30 2021-03-09T10:56:43.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:43.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:56:43.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:43.034+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:56:43.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:43.034+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:56:43.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:43.238+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:56:43.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:43.238+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:56:43.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:43.642+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:56:43.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:43.642+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:56:44.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:44.446+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:56:44.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:44.446+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:56:46.049 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:46.049+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:56:46.049 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:46.049+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:56:47.716 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:56:47.713+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:56:47.717 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:47.713+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:56:47.718 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:47.713+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:56:47.718 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:47.713+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5417 cs=1 l=1).handle_message read tag failed 2021-03-09T10:56:47.718 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:47.713+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5417 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:56:49.255 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:49.253+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:56:49.255 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:49.253+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:56:52.716 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:56:52.713+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:56:55.661 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:55.661+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:56:55.662 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:56:55.661+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:56:57.717 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:56:57.713+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:57:02.717 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:57:02.713+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:57:07.717 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:57:07.717+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:57:08.475 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:08.473+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:57:08.475 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:08.473+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:57:12.717 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:57:12.717+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:57:13.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:13.033+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:57:13.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:13.033+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:57:13.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:13.033+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:57:13.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:13.033+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd20003eb0 2021-03-09T10:57:13.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:13.033+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c5e0 con 0x7fdd2000ef30 2021-03-09T10:57:13.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:13.033+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000f850 con 0x7fdd20006b10 2021-03-09T10:57:13.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:13.033+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:57:13.038 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:13.033+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:57:13.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:13.237+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:57:13.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:13.237+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:57:13.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:13.641+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:57:13.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:13.641+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:57:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:14.445+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:57:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:14.445+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:57:16.049 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:16.049+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:57:16.049 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:16.049+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:57:17.718 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:57:17.717+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:57:17.719 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:17.717+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:57:17.719 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:17.717+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:57:17.719 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:17.717+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5454 cs=1 l=1).handle_message read tag failed 2021-03-09T10:57:17.719 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:17.717+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5454 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:57:19.252 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:19.253+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:57:19.252 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:19.253+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:57:22.718 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:57:22.717+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:57:25.659 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:25.656+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:57:25.659 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:25.656+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:57:27.719 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:57:27.716+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:57:32.719 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:57:32.716+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:57:37.719 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:57:37.720+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:57:38.472 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:38.472+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:57:38.472 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:38.472+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:57:42.719 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:57:42.720+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:57:43.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:43.032+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:57:43.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:43.032+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:57:43.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:43.032+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:57:43.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:43.032+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20003eb0 2021-03-09T10:57:43.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:43.032+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd2000ef30 2021-03-09T10:57:43.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:43.032+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c5e0 con 0x7fdd20006b10 2021-03-09T10:57:43.038 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:43.032+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:57:43.038 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:43.032+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:57:43.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:43.236+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:57:43.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:43.236+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:57:43.639 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:43.640+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:57:43.640 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:43.640+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:57:44.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:44.444+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:57:44.443 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:44.444+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:57:46.047 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:46.048+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:57:46.047 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:46.048+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:57:47.720 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:57:47.720+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:57:47.721 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:47.720+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-03-09T10:57:47.721 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:47.720+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:57:47.722 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:47.720+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5487 cs=1 l=1).handle_message read tag failed 2021-03-09T10:57:47.722 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:47.720+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5487 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:57:49.251 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:49.252+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:57:49.251 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:49.252+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:57:52.720 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:57:52.720+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:57:55.658 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:55.656+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:57:55.659 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:57:55.656+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:57:57.720 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:57:57.720+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:58:02.720 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:58:02.719+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:58:07.720 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:58:07.719+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:58:08.468 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:08.467+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:58:08.470 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:08.467+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:58:12.720 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:58:12.719+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:58:13.036 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:13.035+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:58:13.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:13.035+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:58:13.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:13.035+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:58:13.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:13.035+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd200032a0 2021-03-09T10:58:13.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:13.035+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd2000ef30 2021-03-09T10:58:13.038 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:13.035+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd20006b10 2021-03-09T10:58:13.038 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:13.035+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:58:13.038 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:13.035+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:58:13.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:13.239+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:58:13.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:13.239+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:58:13.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:13.643+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:58:13.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:13.643+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:58:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:14.447+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:58:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:14.447+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:58:16.051 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:16.051+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:58:16.051 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:16.051+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:58:17.721 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:58:17.719+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:58:17.722 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:17.719+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-03-09T10:58:17.722 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:17.719+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:58:17.722 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:17.719+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5504 cs=1 l=1).handle_message read tag failed 2021-03-09T10:58:17.723 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:17.719+0000 7fdd492a2700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5504 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:58:19.255 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:19.255+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:58:19.255 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:19.255+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:58:22.721 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:58:22.719+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:58:25.662 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:25.659+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:58:25.662 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:25.659+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:58:27.721 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:58:27.719+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:58:32.722 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:58:32.719+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:58:37.722 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:58:37.719+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:58:38.475 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:38.474+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:58:38.475 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:38.474+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:58:42.722 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:58:42.718+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:58:43.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:43.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:58:43.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:43.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd2000ef30 legacy=0x7fdd200103e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:58:43.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:43.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:58:43.038 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:43.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c5e0 con 0x7fdd200032a0 2021-03-09T10:58:43.038 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:43.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20003eb0 2021-03-09T10:58:43.038 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:43.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd200144a0 con 0x7fdd20006b10 2021-03-09T10:58:43.039 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:43.034+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:58:43.039 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:43.034+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:58:43.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:43.238+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:58:43.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:43.238+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:58:43.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:43.642+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:58:43.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:43.642+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:58:44.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:44.446+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:58:44.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:44.446+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:58:46.051 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:46.050+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:58:46.051 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:46.050+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:58:47.722 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:58:47.718+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:58:47.723 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:47.718+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 19 2021-03-09T10:58:47.723 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:47.718+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-03-09T10:58:47.724 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:47.718+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5521 cs=1 l=1).handle_message read tag failed 2021-03-09T10:58:47.724 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:47.718+0000 7fdd48aa1700 1 --1- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 0x7fdd2000e780 :-1 s=OPENED pgs=5521 cs=1 l=1).fault on lossy channel, failing 2021-03-09T10:58:49.254 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:49.254+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:58:49.256 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:49.254+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:58:52.722 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:58:52.722+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:58:55.659 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:55.658+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:58:55.663 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:58:55.662+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:58:57.723 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:58:57.722+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:59:02.723 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:59:02.722+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:59:07.723 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:59:07.722+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:59:08.472 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:59:08.470+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:59:08.476 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:59:08.474+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:59:12.726 INFO:tasks.ceph.mon.c.smithi091.stderr:2021-03-09T10:59:12.722+0000 7f110cf2f700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27 slow ops, oldest is log(1 entries from seq 10 at 2021-03-09T08:40:38.873866+0000) 2021-03-09T10:59:13.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:59:13.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6790/0 conn(0x7fdd20006b10 legacy=0x7fdd2000e780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-03-09T10:59:13.037 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:59:13.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:59:13.038 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:59:13.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-03-09T10:59:13.038 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:59:13.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20003680 con 0x7fdd200032a0 2021-03-09T10:59:13.038 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:59:13.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd2000c5e0 con 0x7fdd20003eb0 2021-03-09T10:59:13.038 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:59:13.034+0000 7fdd2b7fe700 1 -- 172.21.15.91:0/2882157385 --> v1:172.21.15.91:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fdd20005050 con 0x7fdd20006b10 2021-03-09T10:59:13.039 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:59:13.034+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:59:13.039 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:59:13.034+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:59:13.238 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:59:13.238+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:59:13.239 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:59:13.238+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:59:13.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:59:13.642+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:59:13.643 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:59:13.642+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:59:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:59:14.446+0000 7fdd48aa1700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.91:6789/0 conn(0x7fdd200032a0 legacy=0x7fdd2000bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.91:6789/0 2021-03-09T10:59:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:2021-03-09T10:59:14.446+0000 7fdd492a2700 1 -- 172.21.15.91:0/2882157385 >> v1:172.21.15.106:6789/0 conn(0x7fdd20003eb0 legacy=0x7fdd2000b7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2021-03-09T10:59:15.666 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-03-09T10:59:15.667 DEBUG:teuthology.task.console_log:Killing console logger for smithi091 2021-03-09T10:59:15.668 DEBUG:teuthology.task.console_log:Killing console logger for smithi106 2021-03-09T10:59:15.669 DEBUG:teuthology.exit:Finished running handlers